2026-03-28 10:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 10:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 10:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-28 10:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 10:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 10:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 10:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 10:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 10:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: c1f761ab4f1c6aff
2026-03-28 10:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 10:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-28T10_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 10:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 10:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 10:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 10:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 10:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-28 10:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 10:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 10:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 10:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 10:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 10:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 10:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 10:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 10:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 10:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 10:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 10:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 10:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 10:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 10:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 10:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 10:30:58 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9613 | hits on page: 40
2026-03-28 10:30:58 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-28 10:30:59 [auto1.de] INFO: Scrape type for XU36975: 2
2026-03-28 10:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-28 10:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-28 10:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-28 10:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c07c6e13-b877-5e52-9d28-864d800235c3, identifier: XU36975
2026-03-28 10:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 10:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 10:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-28 10:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975 to the API
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:11Z',
 'fuel_type': 'diesel',
 'id': 'c07c6e13-b877-5e52-9d28-864d800235c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU36975',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 150814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-28 10:30:59 [auto1.de] INFO: Saving data for XU36975: {'auction_closing_time': 1774883351.0, 'created_time': 1774032302.779476, 'last_price_update_time': 1774693859.947292}
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU36975') HTTP/1.1" 204 0
2026-03-28 10:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:30:59 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 10:30:59 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-28 10:30:59 [auto1.de] INFO: Scrape type for NF23902: 1
2026-03-28 10:30:59 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 10:30:59 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-28 10:31:00 [auto1.de] INFO: Scrape type for TR04886: 2
2026-03-28 10:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-28 10:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-28 10:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-28 10:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609b1033-9c44-5f99-9bac-fda2e590b8cc, identifier: TR04886
2026-03-28 10:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 10:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-28 10:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886 to the API
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '609b1033-9c44-5f99-9bac-fda2e590b8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR04886',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 206563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-28 10:31:00 [auto1.de] INFO: Saving data for TR04886: {'auction_closing_time': 1774885637.0, 'created_time': 1773427570.077662, 'last_price_update_time': 1774693860.649794}
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR04886') HTTP/1.1" 204 0
2026-03-28 10:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:00 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 10:31:00 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 10:31:00 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-28 10:31:00 [auto1.de] INFO: Scrape type for JR73784: 1
2026-03-28 10:31:00 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-28 10:31:00 [auto1.de] INFO: Scrape type for TK15682: 2
2026-03-28 10:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-28 10:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-28 10:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-28 10:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60903643-49cb-5ccd-9b82-f03261647587, identifier: TK15682
2026-03-28 10:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 10:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-28 10:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682 to the API
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:16:08Z',
 'fuel_type': 'diesel',
 'id': '60903643-49cb-5ccd-9b82-f03261647587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK15682',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 157532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2017}
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-28 10:31:01 [auto1.de] INFO: Saving data for TK15682: {'auction_closing_time': 1774883768.0, 'created_time': 1774118855.350655, 'last_price_update_time': 1774693861.294482}
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK15682') HTTP/1.1" 204 0
2026-03-28 10:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:01 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 10:31:01 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 10:31:01 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-28 10:31:01 [auto1.de] INFO: Scrape type for DT59270: 1
2026-03-28 10:31:01 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-28 10:31:01 [auto1.de] INFO: Scrape type for SD29600: 2
2026-03-28 10:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-28 10:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-28 10:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-28 10:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 590baee3-5512-5e1d-a530-48658d9f3432, identifier: SD29600
2026-03-28 10:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 10:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-28 10:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600 to the API
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'petrol',
 'id': '590baee3-5512-5e1d-a530-48658d9f3432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD29600',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 96916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2006}
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-28 10:31:01 [auto1.de] INFO: Saving data for SD29600: {'auction_closing_time': 1774885368.0, 'created_time': 1774348995.464131, 'last_price_update_time': 1774693861.953882}
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD29600') HTTP/1.1" 204 0
2026-03-28 10:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for AY51976: 1
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for KT35256: 2
2026-03-28 10:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-28 10:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-28 10:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-28 10:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 048e54bd-b608-5f6e-853c-0a5ca9facfb2, identifier: KT35256
2026-03-28 10:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 10:31:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-28 10:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256 to the API
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'petrol',
 'id': '048e54bd-b608-5f6e-853c-0a5ca9facfb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT35256',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 55346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2012}
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Saving data for KT35256: {'auction_closing_time': 1774883094.0, 'created_time': 1773400451.799684, 'last_price_update_time': 1774693862.729074}
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT35256') HTTP/1.1" 204 0
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for ZY39038: 1
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for EA52308: 1
2026-03-28 10:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for KD45426: 1
2026-03-28 10:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for VZ43833: 1
2026-03-28 10:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for HA56884: 1
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for FD80393: 1
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 10:31:02 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-28 10:31:02 [auto1.de] INFO: Scrape type for XB41121: 2
2026-03-28 10:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-28 10:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-28 10:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-28 10:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b36653d-e2c2-5ecd-9011-c67d17418b68, identifier: XB41121
2026-03-28 10:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 10:31:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-28 10:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121 to the API
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:42:16Z',
 'fuel_type': 'petrol',
 'id': '2b36653d-e2c2-5ecd-9011-c67d17418b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB41121',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 77230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-05',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-28 10:31:03 [auto1.de] INFO: Saving data for XB41121: {'auction_closing_time': 1774885336.0, 'created_time': 1774379326.006103, 'last_price_update_time': 1774693863.525706}
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB41121') HTTP/1.1" 204 0
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-28 10:31:03 [auto1.de] INFO: Scrape type for DA22909: 1
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-28 10:31:03 [auto1.de] INFO: Scrape type for BF10429: 1
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-28 10:31:03 [auto1.de] INFO: Scrape type for XY13632: 1
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: HP25742
2026-03-28 10:31:03 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-28 10:31:03 [auto1.de] INFO: Scrape type for MH64159: 1
2026-03-28 10:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT59270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:04 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9613 | hits on page: 40
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 10:31:04 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/NF23902/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-28 10:31:04 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: HP25742
2026-03-28 10:31:04 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 10:31:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 6 items (at 6 items/min)
2026-03-28 10:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 10:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF23902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY51976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ43833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR73784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY13632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD80393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:31:59 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9614 | hits on page: 40
2026-03-28 10:31:59 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 10:31:59 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-28 10:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-28 10:31:59 [auto1.de] INFO: Scrape type for CU51280: 2
2026-03-28 10:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-28 10:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-28 10:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-28 10:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2c65ce1-91d9-5ad7-be26-189437fdcd4d, identifier: CU51280
2026-03-28 10:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-28 10:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-28 10:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280 to the API
2026-03-28 10:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 347,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': 'e2c65ce1-91d9-5ad7-be26-189437fdcd4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51280',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 196047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Saving data for CU51280: {'auction_closing_time': 1774885120.0, 'created_time': 1774034236.868814, 'last_price_update_time': 1774693922.091082}
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU51280') HTTP/1.1" 204 0
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Scrape type for TS47391: 1
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Scrape type for JD30879: 2
2026-03-28 10:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-28 10:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-28 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-28 10:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 986c93bc-34d3-51a7-a902-fd33bb552dce, identifier: JD30879
2026-03-28 10:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-28 10:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-28 10:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879 to the API
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'diesel',
 'id': '986c93bc-34d3-51a7-a902-fd33bb552dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD30879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 182490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Saving data for JD30879: {'auction_closing_time': 1774884236.0, 'created_time': 1773426835.783957, 'last_price_update_time': 1774693922.674653}
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD30879') HTTP/1.1" 204 0
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Scrape type for ZF87196: 1
2026-03-28 10:32:02 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-28 10:32:02 [auto1.de] INFO: Scrape type for DK10749: 2
2026-03-28 10:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-28 10:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-28 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-28 10:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651, identifier: DK10749
2026-03-28 10:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 10:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-28 10:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749 to the API
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'diesel',
 'id': '7aeb3d03-ea10-5f2f-96bb-3b626b36a651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK10749',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 132308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Expression',
 'year': 2019}
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-28 10:32:03 [auto1.de] INFO: Saving data for DK10749: {'auction_closing_time': 1774885388.0, 'created_time': 1773427370.390544, 'last_price_update_time': 1774693923.323778}
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10749') HTTP/1.1" 204 0
2026-03-28 10:32:03 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-28 10:32:03 [auto1.de] INFO: Scrape type for DD00982: 1
2026-03-28 10:32:03 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-28 10:32:03 [auto1.de] INFO: Scrape type for JV93942: 1
2026-03-28 10:32:03 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-28 10:32:03 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-28 10:32:03 [auto1.de] INFO: Scrape type for RR37288: 2
2026-03-28 10:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-28 10:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-28 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-28 10:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 233b6197-1e65-53ba-8d93-3013a775cd32, identifier: RR37288
2026-03-28 10:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-28 10:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-28 10:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288 to the API
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:00Z',
 'fuel_type': 'diesel',
 'id': '233b6197-1e65-53ba-8d93-3013a775cd32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR37288',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 269195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Saving data for RR37288: {'auction_closing_time': 1774884660.0, 'created_time': 1774349103.185941, 'last_price_update_time': 1774693924.076641}
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR37288') HTTP/1.1" 204 0
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: PB91995
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for XL20163: 1
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: UD07606
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD07606%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for UD07606: 1
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for RW03523: 1
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for ZY17523: 1
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for GW53776: 1
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-28 10:32:04 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Scrape type for PH41345: 2
2026-03-28 10:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-28 10:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-28 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-28 10:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ab0d43-02be-57de-8893-7f844ef04211, identifier: PH41345
2026-03-28 10:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 10:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-28 10:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345 to the API
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': '85ab0d43-02be-57de-8893-7f844ef04211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH41345',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 210335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-29',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Type S',
 'transmission': 'manual',
 'trim': 'Type S',
 'year': 2009}
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-28 10:32:04 [auto1.de] INFO: Saving data for PH41345: {'auction_closing_time': 1774885371.0, 'created_time': 1774034140.5483, 'last_price_update_time': 1774693924.950222}
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH41345') HTTP/1.1" 204 0
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for FB79072: 1
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for KW07987: 1
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for HC06893: 2
2026-03-28 10:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-28 10:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-28 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-28 10:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0, identifier: HC06893
2026-03-28 10:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-28 10:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-28 10:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893 to the API
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '43ee5ac4-19e2-58ca-8887-fa2d79f8eac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC06893',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 110417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Saving data for HC06893: {'auction_closing_time': 1774886275.0, 'created_time': 1773468614.674972, 'last_price_update_time': 1774693925.578547}
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC06893') HTTP/1.1" 204 0
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for BM85402: 1
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for CA67550: 1
2026-03-28 10:32:05 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-28 10:32:05 [auto1.de] INFO: Scrape type for ZG02351: 2
2026-03-28 10:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-28 10:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-28 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-28 10:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c20aeb-4309-5876-a266-66a51436cbe6, identifier: ZG02351
2026-03-28 10:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-28 10:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-28 10:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351 to the API
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '54c20aeb-4309-5876-a266-66a51436cbe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG02351',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 167168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-26',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2018}
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-28 10:32:06 [auto1.de] INFO: Saving data for ZG02351: {'auction_closing_time': 1774885637.0, 'created_time': 1773467251.130645, 'last_price_update_time': 1774693926.280028}
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG02351') HTTP/1.1" 204 0
2026-03-28 10:32:06 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-28 10:32:06 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-28 10:32:06 [auto1.de] INFO: Scrape type for UK87241: 1
2026-03-28 10:32:06 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 7 pages/min), scraped 13 items (at 7 items/min)
2026-03-28 10:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 10:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT59270> (referer: https://www.auto1.com/v1/car-details-view/DT59270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-28 10:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with scrape type 1
2026-03-28 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_e5b71726cd5a432b96e0698870597b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_e5b71726cd5a432b96e0698870597b0c.jpg already downloaded
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_8e690c4fb65562e799032d18936ed3c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_8e690c4fb65562e799032d18936ed3c1.jpg already downloaded
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_6ea809cda86543eacc2f16c811c09091.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_6ea809cda86543eacc2f16c811c09091.jpg already downloaded
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_f2aed5538b7269faec87afdb27e140f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f2aed5538b7269faec87afdb27e140f1.jpg already downloaded
2026-03-28 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_b8db951c559de40c81e0acc317d5381a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_b8db951c559de40c81e0acc317d5381a.jpg already downloaded
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_f4aa01e7360d68f455d3c2187a4e23fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f4aa01e7360d68f455d3c2187a4e23fd.jpg already downloaded
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_42313d69d8bcbc75437d2dad0cfe6ca2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_42313d69d8bcbc75437d2dad0cfe6ca2.jpg already downloaded
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_895e7b4ce8fb43af1d2bbf16dd57009a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_895e7b4ce8fb43af1d2bbf16dd57009a.jpg already downloaded
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_d7b320cf20a87a4b96dff21d110f6a63.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_d7b320cf20a87a4b96dff21d110f6a63.jpg already downloaded
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fad%252F6cad6a3fcdef94f2d7c1c975af1ed877%252Fpa%252FDT59270_de3dec028990eeb5d6efceab4fab2a86.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_de3dec028990eeb5d6efceab4fab2a86.jpg already downloaded
2026-03-28 10:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335, identifier: DT59270
2026-03-28 10:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-28 10:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-28 10:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270 to the API
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT59270>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:18Z',
 'fuel_type': 'petrol',
 'id': '1a3e11d4-bc1d-57e5-b3d9-ff25ff247335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT59270',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'BMW',
 'model': '1er',
 'odometer': 45447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_e5b71726cd5a432b96e0698870597b0c.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_8e690c4fb65562e799032d18936ed3c1.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_6ea809cda86543eacc2f16c811c09091.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f2aed5538b7269faec87afdb27e140f1.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_b8db951c559de40c81e0acc317d5381a.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f4aa01e7360d68f455d3c2187a4e23fd.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_42313d69d8bcbc75437d2dad0cfe6ca2.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_895e7b4ce8fb43af1d2bbf16dd57009a.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_d7b320cf20a87a4b96dff21d110f6a63.jpg',
                'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_de3dec028990eeb5d6efceab4fab2a86.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_e5b71726cd5a432b96e0698870597b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_8e690c4fb65562e799032d18936ed3c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_6ea809cda86543eacc2f16c811c09091.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f2aed5538b7269faec87afdb27e140f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_b8db951c559de40c81e0acc317d5381a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_f4aa01e7360d68f455d3c2187a4e23fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_42313d69d8bcbc75437d2dad0cfe6ca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_895e7b4ce8fb43af1d2bbf16dd57009a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_d7b320cf20a87a4b96dff21d110f6a63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3e11d4-bc1d-57e5-b3d9-ff25ff247335/1a3e11d4-bc1d-57e5-b3d9-ff25ff247335_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ad/6cad6a3fcdef94f2d7c1c975af1ed877/pa/DT59270_de3dec028990eeb5d6efceab4fab2a86.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-28 10:32:08 [auto1.de] INFO: Saving data for DT59270: {'created_time': 1774693928.776859, 'last_price_update_time': 1774693928.776879, 'auction_closing_time': 1774885458.0}
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT59270') HTTP/1.1" 204 0
2026-03-28 10:33:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 1 pages/min), scraped 14 items (at 1 items/min)
2026-03-28 10:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.568(s), this was the 1st time calling it.
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.980827681706299 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.587(s), this was the 1st time calling it.
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.952524773392335 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.638(s), this was the 1st time calling it.
2026-03-28 10:33:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.972831825878266 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.770(s), this was the 1st time calling it.
2026-03-28 10:33:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.891355593469459 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.141(s), this was the 1st time calling it.
2026-03-28 10:33:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.151747697748686 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.212(s), this was the 1st time calling it.
2026-03-28 10:33:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.260192544999162 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.319(s), this was the 1st time calling it.
2026-03-28 10:33:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.5760769560885945 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:33:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD45426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA52308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ43833> (referer: https://www.auto1.com/v1/car-details-view/VZ43833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-28 10:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 1
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_434438668dc55b52e9e2a7b5080438f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_434438668dc55b52e9e2a7b5080438f6.jpg not downloaded yet
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_09bc930853d26a5fabd814d884ed3c19.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_09bc930853d26a5fabd814d884ed3c19.jpg not downloaded yet
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg not downloaded yet
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_b4d037d691152a850648a18a7c66aef9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_b4d037d691152a850648a18a7c66aef9.jpg not downloaded yet
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg not downloaded yet
2026-03-28 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR73784> (referer: https://www.auto1.com/v1/car-details-view/JR73784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-28 10:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5971df60-ac54-5a7b-ad21-40a94a0553b9 with scrape type 1
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5971df60-ac54-5a7b-ad21-40a94a0553b9
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_203e8eab720f6dd33a5e29899a5859e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_203e8eab720f6dd33a5e29899a5859e2.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_49c81a5e2719de818c8a3a5e581cd61c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_49c81a5e2719de818c8a3a5e581cd61c.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_3290b2926d5d4da767b710e7f769cd39.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3290b2926d5d4da767b710e7f769cd39.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_b9238578a037b11c628bcbf00abad9b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_b9238578a037b11c628bcbf00abad9b4.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_29f969ab0f3c066d6488261aefcaff49.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_29f969ab0f3c066d6488261aefcaff49.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_9e696b417b4bd7ec43cf325e13e37f26.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_9e696b417b4bd7ec43cf325e13e37f26.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_dacc1e416e78812f92b5a2106326186b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_dacc1e416e78812f92b5a2106326186b.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_4ecb9b66aa8e9e5e7f0bd49dbfe877e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_4ecb9b66aa8e9e5e7f0bd49dbfe877e9.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_3108d6948b1ae90d43dbeda490c80695.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3108d6948b1ae90d43dbeda490c80695.jpg already downloaded
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F80%252Fd1804f5f105fd13475335511f10ad7fc%252Fpa%252FJR73784_78ef2699bc23a004f5bb5933f8c04901.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_78ef2699bc23a004f5bb5933f8c04901.jpg already downloaded
2026-03-28 10:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5971df60-ac54-5a7b-ad21-40a94a0553b9, identifier: JR73784
2026-03-28 10:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-28 10:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-28 10:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784 to the API
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR73784>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:28:10Z',
 'fuel_type': 'diesel',
 'id': '5971df60-ac54-5a7b-ad21-40a94a0553b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR73784',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 109757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_203e8eab720f6dd33a5e29899a5859e2.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_49c81a5e2719de818c8a3a5e581cd61c.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3290b2926d5d4da767b710e7f769cd39.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_b9238578a037b11c628bcbf00abad9b4.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_29f969ab0f3c066d6488261aefcaff49.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_9e696b417b4bd7ec43cf325e13e37f26.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_dacc1e416e78812f92b5a2106326186b.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_4ecb9b66aa8e9e5e7f0bd49dbfe877e9.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3108d6948b1ae90d43dbeda490c80695.jpg',
                'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_78ef2699bc23a004f5bb5933f8c04901.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3205924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_203e8eab720f6dd33a5e29899a5859e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_49c81a5e2719de818c8a3a5e581cd61c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3290b2926d5d4da767b710e7f769cd39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_b9238578a037b11c628bcbf00abad9b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3581804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_29f969ab0f3c066d6488261aefcaff49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_9e696b417b4bd7ec43cf325e13e37f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_dacc1e416e78812f92b5a2106326186b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_4ecb9b66aa8e9e5e7f0bd49dbfe877e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3341270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_3108d6948b1ae90d43dbeda490c80695.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5971df60-ac54-5a7b-ad21-40a94a0553b9/5971df60-ac54-5a7b-ad21-40a94a0553b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3229395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/80/d1804f5f105fd13475335511f10ad7fc/pa/JR73784_78ef2699bc23a004f5bb5933f8c04901.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-28 10:33:42 [auto1.de] INFO: Saving data for JR73784: {'created_time': 1774694022.727475, 'last_price_update_time': 1774694022.727488, 'auction_closing_time': 1774884490.0}
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR73784') HTTP/1.1" 204 0
2026-03-28 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_b4d037d691152a850648a18a7c66aef9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 10:33:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55911050>
2026-03-28 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg saved to cache
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_09bc930853d26a5fabd814d884ed3c19.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6dd4d0>
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_b4d037d691152a850648a18a7c66aef9.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_b4d037d691152a850648a18a7c66aef9.jpg saved to cache
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5863d0>
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg saved to cache
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f59ba10>
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_09bc930853d26a5fabd814d884ed3c19.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_09bc930853d26a5fabd814d884ed3c19.jpg saved to cache
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_434438668dc55b52e9e2a7b5080438f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f67db90>
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa1%252F92a142932f31b40db4583eddbc6a3a40%252Fpa%252FVZ43833_434438668dc55b52e9e2a7b5080438f6.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_434438668dc55b52e9e2a7b5080438f6.jpg saved to cache
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91311945-c782-5129-99f1-86f0e2beccdd
2026-03-28 10:33:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91311945-c782-5129-99f1-86f0e2beccdd, skipping ID generation
2026-03-28 10:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 1
2026-03-28 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91311945-c782-5129-99f1-86f0e2beccdd sending to next pipeline
2026-03-28 10:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91311945-c782-5129-99f1-86f0e2beccdd, identifier: VZ43833
2026-03-28 10:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-28 10:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-28 10:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833 to the API
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_434438668dc55b52e9e2a7b5080438f6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:11:47Z',
 'fuel_type': 'petrol',
 'id': '91311945-c782-5129-99f1-86f0e2beccdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ43833',
 'listing': 'auction',
 'location': 'DE, Karlsruhe',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 167392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_434438668dc55b52e9e2a7b5080438f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_09bc930853d26a5fabd814d884ed3c19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_a48eb8b0deb17b4a5cd02dfe329396f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_b4d037d691152a850648a18a7c66aef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91311945-c782-5129-99f1-86f0e2beccdd/91311945-c782-5129-99f1-86f0e2beccdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a1/92a142932f31b40db4583eddbc6a3a40/pa/VZ43833_13a5a38d32a6cc8748ef7b5a68a168a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-28 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-28 10:33:44 [auto1.de] INFO: Saving data for VZ43833: {'created_time': 1774694024.004512, 'last_price_update_time': 1774694024.004524, 'auction_closing_time': 1774883507.0}
2026-03-28 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ43833') HTTP/1.1" 204 0
2026-03-28 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY51976> (referer: https://www.auto1.com/v1/car-details-view/AY51976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-28 10:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 1
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_2341816391a4c799087a71f3b60b2360.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_2341816391a4c799087a71f3b60b2360.jpg not downloaded yet
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg not downloaded yet
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg not downloaded yet
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_f32945094ca11ed876b045e0f644fb32.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_f32945094ca11ed876b045e0f644fb32.jpg not downloaded yet
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg not downloaded yet
2026-03-28 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD80393> (referer: https://www.auto1.com/v1/car-details-view/FD80393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-28 10:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 1
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg not downloaded yet
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_078d84ef2267ee97233101fb50b529c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_078d84ef2267ee97233101fb50b529c8.jpg not downloaded yet
2026-03-28 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_535b4e46c0d08530a12f08548042c13e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_535b4e46c0d08530a12f08548042c13e.jpg not downloaded yet
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg not downloaded yet
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg not downloaded yet
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_55b56b466b8fa083245397af3fb22552.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_55b56b466b8fa083245397af3fb22552.jpg not downloaded yet
2026-03-28 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f616850>
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg saved to cache
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_55b56b466b8fa083245397af3fb22552.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f562810>
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg saved to cache
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f615ad0>
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_55b56b466b8fa083245397af3fb22552.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_55b56b466b8fa083245397af3fb22552.jpg saved to cache
2026-03-28 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bf850>
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg saved to cache
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_535b4e46c0d08530a12f08548042c13e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f572210>
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg saved to cache
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f560c90>
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_535b4e46c0d08530a12f08548042c13e.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_535b4e46c0d08530a12f08548042c13e.jpg saved to cache
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_078d84ef2267ee97233101fb50b529c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a79d0>
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F4c%252Fe94c75e32bdc8b76c7a893d2f8296390%252Fpa%252FFD80393_078d84ef2267ee97233101fb50b529c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_078d84ef2267ee97233101fb50b529c8.jpg saved to cache
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd515e07-5960-5374-8338-10aced789a66
2026-03-28 10:33:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd515e07-5960-5374-8338-10aced789a66, skipping ID generation
2026-03-28 10:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 1
2026-03-28 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd515e07-5960-5374-8338-10aced789a66 sending to next pipeline
2026-03-28 10:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd515e07-5960-5374-8338-10aced789a66, identifier: FD80393
2026-03-28 10:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-28 10:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-28 10:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393 to the API
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_078d84ef2267ee97233101fb50b529c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'diesel',
 'id': 'fd515e07-5960-5374-8338-10aced789a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD80393',
 'listing': 'auction',
 'location': 'DE, Saarbrücken',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 247605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_b6c44a47dab4f5ec2c13f3c0ba4b8ae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_078d84ef2267ee97233101fb50b529c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_535b4e46c0d08530a12f08548042c13e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_fc06e6d98cfbfb49696d8657e71b1509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_be2d588fb651d50f4cf32bc9754cf57e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd515e07-5960-5374-8338-10aced789a66/fd515e07-5960-5374-8338-10aced789a66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/4c/e94c75e32bdc8b76c7a893d2f8296390/pa/FD80393_55b56b466b8fa083245397af3fb22552.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Saving data for FD80393: {'created_time': 1774694030.039177, 'last_price_update_time': 1774694030.039187, 'auction_closing_time': 1774882887.0}
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD80393') HTTP/1.1" 204 0
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_f32945094ca11ed876b045e0f644fb32.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY13632> (referer: https://www.auto1.com/v1/car-details-view/XY13632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f671710>
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_f32945094ca11ed876b045e0f644fb32.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_f32945094ca11ed876b045e0f644fb32.jpg saved to cache
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:50 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9619 | hits on page: 40
2026-03-28 10:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-28 10:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 1
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_218800fac86f166e3e85e3a2868625b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_218800fac86f166e3e85e3a2868625b3.jpg not downloaded yet
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg not downloaded yet
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg not downloaded yet
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bcdd0>
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg saved to cache
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_2341816391a4c799087a71f3b60b2360.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_d7e828714ee9144e2480c171412e55aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d7e828714ee9144e2480c171412e55aa.jpg not downloaded yet
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Scrape type for PJ27517: 2
2026-03-28 10:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-28 10:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-28 10:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2752d5-bd08-5c65-a7f9-0cc37aeb259d, identifier: PJ27517
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_77e27fb1af0059efe53985b399ceefeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_77e27fb1af0059efe53985b399ceefeb.jpg not downloaded yet
2026-03-28 10:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-28 10:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-28 10:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517 to the API
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:06:21Z',
 'fuel_type': 'petrol',
 'id': 'da2752d5-bd08-5c65-a7f9-0cc37aeb259d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ27517',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 16544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2024}
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Saving data for PJ27517: {'auction_closing_time': 1774883181.0, 'created_time': 1774350281.849803, 'last_price_update_time': 1774694030.870099}
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ27517') HTTP/1.1" 204 0
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Scrape type for MN00804: 1
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_9311afa95351911115a33e2570d7355a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9311afa95351911115a33e2570d7355a.jpg not downloaded yet
2026-03-28 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-28 10:33:50 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-28 10:33:50 [auto1.de] INFO: Scrape type for GH25955: 2
2026-03-28 10:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-28 10:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-28 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-28 10:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 399c574b-d314-5e64-898d-9b6abd286a56, identifier: GH25955
2026-03-28 10:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-28 10:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-28 10:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955 to the API
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:09Z',
 'fuel_type': 'diesel',
 'id': '399c574b-d314-5e64-898d-9b6abd286a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH25955',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 137748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2014}
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-28 10:33:51 [auto1.de] INFO: Saving data for GH25955: {'auction_closing_time': 1774883829.0, 'created_time': 1774349915.017703, 'last_price_update_time': 1774694031.391995}
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH25955') HTTP/1.1" 204 0
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec26110>
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_2341816391a4c799087a71f3b60b2360.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_2341816391a4c799087a71f3b60b2360.jpg saved to cache
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:51 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-28 10:33:51 [auto1.de] INFO: Scrape type for AF81396: 2
2026-03-28 10:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-28 10:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-28 10:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b62c02c-ca5b-5358-a986-8d8e1156bae0, identifier: AF81396
2026-03-28 10:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-28 10:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-28 10:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396 to the API
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:51Z',
 'fuel_type': 'petrol',
 'id': '7b62c02c-ca5b-5358-a986-8d8e1156bae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF81396',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 69525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Edition BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Edition BlueMotion Tech',
 'year': 2015}
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-28 10:33:51 [auto1.de] INFO: Saving data for AF81396: {'auction_closing_time': 1774886031.0, 'created_time': 1773467103.296941, 'last_price_update_time': 1774694031.918084}
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF81396') HTTP/1.1" 204 0
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e2b90>
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F4c%252F9c4c269180e190d9e07ae2653d19ae32%252Fpa%252FAY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg saved to cache
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a
2026-03-28 10:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a, skipping ID generation
2026-03-28 10:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 1
2026-03-28 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a sending to next pipeline
2026-03-28 10:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a, identifier: AY51976
2026-03-28 10:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5ea590>
2026-03-28 10:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg saved to cache
2026-03-28 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:52 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-28 10:33:52 [auto1.de] INFO: Scrape type for FJ89028: 2
2026-03-28 10:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-28 10:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-28 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-28 10:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6fdad1-e21a-5820-9fae-a30a17add957, identifier: FJ89028
2026-03-28 10:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-28 10:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-28 10:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976 to the API
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:59:07Z',
 'fuel_type': 'petrol',
 'id': '8bfa0bbd-d13d-5301-ae16-bb3e967a884a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY51976',
 'listing': 'auction',
 'location': 'DE, Montabaur',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_2341816391a4c799087a71f3b60b2360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_4d49398ad0fb3ad87ed1a64a28f928e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_9df9b640a40ffd177cf4f684a1c9bc9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_f32945094ca11ed876b045e0f644fb32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bfa0bbd-d13d-5301-ae16-bb3e967a884a/8bfa0bbd-d13d-5301-ae16-bb3e967a884a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/4c/9c4c269180e190d9e07ae2653d19ae32/pa/AY51976_3d25d2d4290f9725b9821b45e3cfe2c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-28 10:33:52 [auto1.de] INFO: Saving data for AY51976: {'created_time': 1774694032.577939, 'last_price_update_time': 1774694032.577953, 'auction_closing_time': 1774886347.0}
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY51976') HTTP/1.1" 204 0
2026-03-28 10:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_77e27fb1af0059efe53985b399ceefeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 10:33:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 10:33:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-28 10:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028 to the API
2026-03-28 10:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:21:30Z',
 'fuel_type': 'hybrid',
 'id': '0f6fdad1-e21a-5820-9fae-a30a17add957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ89028',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 272614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-28 10:33:53 [auto1.de] INFO: Saving data for FJ89028: {'auction_closing_time': 1774884090.0, 'created_time': 1773401968.489246, 'last_price_update_time': 1774694033.195733}
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ89028') HTTP/1.1" 204 0
2026-03-28 10:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9311afa95351911115a33e2570d7355a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:53 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-28 10:33:53 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-28 10:33:53 [auto1.de] INFO: Scrape type for GY71036: 1
2026-03-28 10:33:53 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-28 10:33:53 [auto1.de] INFO: Scrape type for HB96226: 2
2026-03-28 10:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-28 10:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-28 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-28 10:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7, identifier: HB96226
2026-03-28 10:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f573610>
2026-03-28 10:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_77e27fb1af0059efe53985b399ceefeb.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_77e27fb1af0059efe53985b399ceefeb.jpg saved to cache
2026-03-28 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-28 10:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-28 10:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226 to the API
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:24Z',
 'fuel_type': 'diesel',
 'id': '2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB96226',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 221823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-28 10:33:53 [auto1.de] INFO: Saving data for HB96226: {'auction_closing_time': 1774885044.0, 'created_time': 1773426880.942882, 'last_price_update_time': 1774694033.700416}
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB96226') HTTP/1.1" 204 0
2026-03-28 10:33:53 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-28 10:33:53 [auto1.de] INFO: Scrape type for GS36349: 2
2026-03-28 10:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-28 10:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-28 10:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-28 10:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5b91dd-e884-5a51-9283-2e39b9dae6a3, identifier: GS36349
2026-03-28 10:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-28 10:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-28 10:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349 to the API
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'petrol',
 'id': 'ad5b91dd-e884-5a51-9283-2e39b9dae6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36349',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 50732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid Selection 2WD',
 'transmission': 'automatic',
 'trim': 'Selection 2WD',
 'year': 2019}
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-28 10:33:54 [auto1.de] INFO: Saving data for GS36349: {'auction_closing_time': 1774885759.0, 'created_time': 1774032438.513994, 'last_price_update_time': 1774694034.260158}
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36349') HTTP/1.1" 204 0
2026-03-28 10:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d7e828714ee9144e2480c171412e55aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:54 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-28 10:33:54 [auto1.de] INFO: Scrape type for HA50795: 2
2026-03-28 10:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-28 10:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-28 10:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-28 10:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7b8361-18dd-5948-9838-350ac5ee585e, identifier: HA50795
2026-03-28 10:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-28 10:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-28 10:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795 to the API
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'diesel',
 'id': 'fc7b8361-18dd-5948-9838-350ac5ee585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA50795',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 90462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Trend',
 'transmission': 'automatic',
 'trim': '320 L2 Trend',
 'year': 2019}
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-28 10:33:54 [auto1.de] INFO: Saving data for HA50795: {'auction_closing_time': 1774886239.0, 'created_time': 1774089338.447405, 'last_price_update_time': 1774694034.749695}
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA50795') HTTP/1.1" 204 0
2026-03-28 10:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f563450>
2026-03-28 10:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_9311afa95351911115a33e2570d7355a.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9311afa95351911115a33e2570d7355a.jpg saved to cache
2026-03-28 10:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:54 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-28 10:33:54 [auto1.de] INFO: Scrape type for UZ55149: 2
2026-03-28 10:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-28 10:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-28 10:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-28 10:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46eb9f3e-63d4-5f4d-b705-acb3dd131886, identifier: UZ55149
2026-03-28 10:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:33:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 10:33:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-28 10:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149 to the API
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': '46eb9f3e-63d4-5f4d-b705-acb3dd131886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ55149',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 188538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Saving data for UZ55149: {'auction_closing_time': 1774884997.0, 'created_time': 1774118803.908816, 'last_price_update_time': 1774694035.385111}
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ55149') HTTP/1.1" 204 0
2026-03-28 10:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f573b10>
2026-03-28 10:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_d7e828714ee9144e2480c171412e55aa.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d7e828714ee9144e2480c171412e55aa.jpg saved to cache
2026-03-28 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for NC03535: 2
2026-03-28 10:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-28 10:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-28 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-28 10:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ad6f15-00d9-5c62-b030-072a353c5614, identifier: NC03535
2026-03-28 10:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-28 10:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-28 10:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535 to the API
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:01Z',
 'fuel_type': 'diesel',
 'id': '75ad6f15-00d9-5c62-b030-072a353c5614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC03535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 111998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Saving data for NC03535: {'auction_closing_time': 1774884061.0, 'created_time': 1774349312.394359, 'last_price_update_time': 1774694035.868622}
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC03535') HTTP/1.1" 204 0
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for HR22131: 1
2026-03-28 10:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH64159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for YM01256: 1
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for AD09354: 1
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for YD36788: 1
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-28 10:33:55 [auto1.de] INFO: Scrape type for EY64053: 1
2026-03-28 10:33:55 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-28 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for NK14391: 1
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for HA88960: 1
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for CV20886: 1
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for BF20079: 1
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for YH86831: 1
2026-03-28 10:33:56 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Scrape type for GU24004: 2
2026-03-28 10:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-28 10:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-28 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-28 10:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1ac83ee-d2d0-5830-bbad-b7457acecb1d, identifier: GU24004
2026-03-28 10:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-28 10:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-28 10:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004 to the API
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'petrol',
 'id': 'c1ac83ee-d2d0-5830-bbad-b7457acecb1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU24004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 55588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-28 10:33:56 [auto1.de] INFO: Saving data for GU24004: {'auction_closing_time': 1774886398.0, 'created_time': 1774031449.386222, 'last_price_update_time': 1774694036.525835}
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU24004') HTTP/1.1" 204 0
2026-03-28 10:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f585410>
2026-03-28 10:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg saved to cache
2026-03-28 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA67550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY39038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA56884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS47391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD45426> (referer: https://www.auto1.com/v1/car-details-view/KD45426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-28 10:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 1
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_56e0e483f015ce43d2f31f1f04982857.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_56e0e483f015ce43d2f31f1f04982857.jpg not downloaded yet
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg not downloaded yet
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg not downloaded yet
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg not downloaded yet
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg not downloaded yet
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_474a7b78a079d02f688c7e1a31239ce1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_474a7b78a079d02f688c7e1a31239ce1.jpg not downloaded yet
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW07987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_474a7b78a079d02f688c7e1a31239ce1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM85402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f4790>
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_474a7b78a079d02f688c7e1a31239ce1.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_474a7b78a079d02f688c7e1a31239ce1.jpg saved to cache
2026-03-28 10:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e3ed0>
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg') HTTP/1.1" 204 0
2026-03-28 10:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg saved to cache
2026-03-28 10:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN00804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b9450>
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg saved to cache
2026-03-28 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF10429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a3d10>
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg saved to cache
2026-03-28 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6770d0>
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg saved to cache
2026-03-28 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA22909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_56e0e483f015ce43d2f31f1f04982857.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f78c410>
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8c%252F998c946edd16729e4229c5849b36c122%252Fpa%252FKD45426_56e0e483f015ce43d2f31f1f04982857.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_56e0e483f015ce43d2f31f1f04982857.jpg saved to cache
2026-03-28 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa4bc764-7243-5587-b194-1babaecb520b
2026-03-28 10:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa4bc764-7243-5587-b194-1babaecb520b, skipping ID generation
2026-03-28 10:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 1
2026-03-28 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa4bc764-7243-5587-b194-1babaecb520b sending to next pipeline
2026-03-28 10:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa4bc764-7243-5587-b194-1babaecb520b, identifier: KD45426
2026-03-28 10:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-28 10:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-28 10:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426 to the API
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_56e0e483f015ce43d2f31f1f04982857.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:35:24Z',
 'fuel_type': 'petrol',
 'id': 'fa4bc764-7243-5587-b194-1babaecb520b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD45426',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'BMW',
 'model': '3er',
 'odometer': 141760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_56e0e483f015ce43d2f31f1f04982857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_f3040b49534c9ca0ecfdbe56c47aad84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_1b1bd21bc39d539cc5eae83cba92c978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_0f810b06f1723a9c84d58fcb3b1087e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_eea8d4623b16d53f5dfc9af952c7f6e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa4bc764-7243-5587-b194-1babaecb520b/fa4bc764-7243-5587-b194-1babaecb520b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/8c/998c946edd16729e4229c5849b36c122/pa/KD45426_474a7b78a079d02f688c7e1a31239ce1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-28 10:34:01 [auto1.de] INFO: Saving data for KD45426: {'created_time': 1774694041.978312, 'last_price_update_time': 1774694041.978325, 'auction_closing_time': 1774884924.0}
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD45426') HTTP/1.1" 204 0
2026-03-28 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF20079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH86831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB79072/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK87241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA56884> (referer: https://www.auto1.com/v1/car-details-view/HA56884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-28 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 1
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_9370d6d3782410502b0de968c59f081b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9370d6d3782410502b0de968c59f081b.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_9d64f513789379a9a5c7485b64134be5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9d64f513789379a9a5c7485b64134be5.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_94f50e6892f9453daae3557f4a170626.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_94f50e6892f9453daae3557f4a170626.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS47391> (referer: https://www.auto1.com/v1/car-details-view/TS47391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY71036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_3cb2ef648c83b8158345e587f7929079.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_3cb2ef648c83b8158345e587f7929079.jpg not downloaded yet
2026-03-28 10:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_94f50e6892f9453daae3557f4a170626.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9d64f513789379a9a5c7485b64134be5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-28 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 1
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_85aab57839ff08f2cfbba7994c64eb47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_85aab57839ff08f2cfbba7994c64eb47.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_03434b659afafb160baaaa37284dc902.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_03434b659afafb160baaaa37284dc902.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9370d6d3782410502b0de968c59f081b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_5a530108ae3b6c2905081dc2517cc10c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_5a530108ae3b6c2905081dc2517cc10c.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_87784f5066e581eed469864a2f4e678b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_87784f5066e581eed469864a2f4e678b.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_f6539d2bc39520556154ffac632b24c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_f6539d2bc39520556154ffac632b24c9.jpg not downloaded yet
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5c3c90>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_94f50e6892f9453daae3557f4a170626.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_94f50e6892f9453daae3557f4a170626.jpg saved to cache
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec0bb90>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_9d64f513789379a9a5c7485b64134be5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9d64f513789379a9a5c7485b64134be5.jpg saved to cache
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_3cb2ef648c83b8158345e587f7929079.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_403360131a5b9924d8aa8c4f76f1df58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_403360131a5b9924d8aa8c4f76f1df58.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW07987> (referer: https://www.auto1.com/v1/car-details-view/KW07987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a0c50>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_9370d6d3782410502b0de968c59f081b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9370d6d3782410502b0de968c59f081b.jpg saved to cache
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_82e8e3982a40e893d5fc26800361066d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_82e8e3982a40e893d5fc26800361066d.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_8da0e49b89e882ebba2d6df8773986e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_8da0e49b89e882ebba2d6df8773986e1.jpg not downloaded yet
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5852d0>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_3cb2ef648c83b8158345e587f7929079.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_3cb2ef648c83b8158345e587f7929079.jpg saved to cache
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-28 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 1
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_b050a15940d4422c5c2501b91b30e08d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b050a15940d4422c5c2501b91b30e08d.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_f6539d2bc39520556154ffac632b24c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_65670d209dbedd5c2082590132e72c8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_65670d209dbedd5c2082590132e72c8f.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_7d82a1bce029806d7b518e351c85c353.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_7d82a1bce029806d7b518e351c85c353.jpg not downloaded yet
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg not downloaded yet
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_85aab57839ff08f2cfbba7994c64eb47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f584e50>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_f6539d2bc39520556154ffac632b24c9.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_f6539d2bc39520556154ffac632b24c9.jpg saved to cache
2026-03-28 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec13c10>
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f564fd0>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_85aab57839ff08f2cfbba7994c64eb47.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_85aab57839ff08f2cfbba7994c64eb47.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e9610>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a7fd0>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN00804> (referer: https://www.auto1.com/v1/car-details-view/MN00804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-28 10:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 1
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_567e363c608c59e59979c6d7a40dc7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_567e363c608c59e59979c6d7a40dc7db.jpg not downloaded yet
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_df9252a54cd3ae8edfd12535380b2f97.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_df9252a54cd3ae8edfd12535380b2f97.jpg not downloaded yet
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg not downloaded yet
2026-03-28 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5ba450>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_59b239160f21c5f1a9061d9a27eedb33.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_59b239160f21c5f1a9061d9a27eedb33.jpg not downloaded yet
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_78bb296d691a73cd26bc16d31587ec41.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_78bb296d691a73cd26bc16d31587ec41.jpg not downloaded yet
2026-03-28 10:34:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec09450>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7db590>
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg saved to cache
2026-03-28 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_e61d76c8d84534ff39329400e35d595b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_e61d76c8d84534ff39329400e35d595b.jpg not downloaded yet
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_df9252a54cd3ae8edfd12535380b2f97.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_1a8f90a6896dded273359da77c4ff7f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_1a8f90a6896dded273359da77c4ff7f0.jpg not downloaded yet
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg not downloaded yet
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_256d272b56f6253b045924e172804a9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_256d272b56f6253b045924e172804a9f.jpg not downloaded yet
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg not downloaded yet
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_7d82a1bce029806d7b518e351c85c353.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_65670d209dbedd5c2082590132e72c8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e3210>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_df9252a54cd3ae8edfd12535380b2f97.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_df9252a54cd3ae8edfd12535380b2f97.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_78bb296d691a73cd26bc16d31587ec41.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b3250>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_7d82a1bce029806d7b518e351c85c353.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_7d82a1bce029806d7b518e351c85c353.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a5d90>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5d9c90>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_65670d209dbedd5c2082590132e72c8f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_65670d209dbedd5c2082590132e72c8f.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f566b90>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_78bb296d691a73cd26bc16d31587ec41.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_78bb296d691a73cd26bc16d31587ec41.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_256d272b56f6253b045924e172804a9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f785fd0>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg saved to cache
2026-03-28 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_1a8f90a6896dded273359da77c4ff7f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a0250>
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_256d272b56f6253b045924e172804a9f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_256d272b56f6253b045924e172804a9f.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f683310>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_1a8f90a6896dded273359da77c4ff7f0.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_1a8f90a6896dded273359da77c4ff7f0.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_e61d76c8d84534ff39329400e35d595b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_59b239160f21c5f1a9061d9a27eedb33.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_567e363c608c59e59979c6d7a40dc7db.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e1390>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec8acd0>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5ea250>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_e61d76c8d84534ff39329400e35d595b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_e61d76c8d84534ff39329400e35d595b.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca75d0>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_59b239160f21c5f1a9061d9a27eedb33.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_59b239160f21c5f1a9061d9a27eedb33.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecac750>
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22470b93b424abae35f9eb2f475041d3%252Fpa%252FMN00804_567e363c608c59e59979c6d7a40dc7db.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_567e363c608c59e59979c6d7a40dc7db.jpg saved to cache
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afd08d62-e04d-59c5-a09a-0a28284a469d
2026-03-28 10:34:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afd08d62-e04d-59c5-a09a-0a28284a469d, skipping ID generation
2026-03-28 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 1
2026-03-28 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afd08d62-e04d-59c5-a09a-0a28284a469d sending to next pipeline
2026-03-28 10:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afd08d62-e04d-59c5-a09a-0a28284a469d, identifier: MN00804
2026-03-28 10:34:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f64b250>
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg saved to cache
2026-03-28 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-28 10:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-28 10:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804 to the API
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_567e363c608c59e59979c6d7a40dc7db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:32:23Z',
 'fuel_type': 'petrol',
 'id': 'afd08d62-e04d-59c5-a09a-0a28284a469d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN00804',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 180256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_567e363c608c59e59979c6d7a40dc7db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_df9252a54cd3ae8edfd12535380b2f97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_b9b15cfe4bbc44c0d4a4cbb351205403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_59b239160f21c5f1a9061d9a27eedb33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_78bb296d691a73cd26bc16d31587ec41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_e61d76c8d84534ff39329400e35d595b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_1a8f90a6896dded273359da77c4ff7f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_a7ce5044b1a50a3601e3ffd16dae639c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_256d272b56f6253b045924e172804a9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afd08d62-e04d-59c5-a09a-0a28284a469d/afd08d62-e04d-59c5-a09a-0a28284a469d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22470b93b424abae35f9eb2f475041d3/pa/MN00804_ea2489f0c28c7eec705172cfab6c54e7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-28 10:34:07 [auto1.de] INFO: Saving data for MN00804: {'created_time': 1774694047.652062, 'last_price_update_time': 1774694047.652076, 'auction_closing_time': 1774884743.0}
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN00804') HTTP/1.1" 204 0
2026-03-28 10:34:07 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 28 pages/min), scraped 30 items (at 16 items/min)
2026-03-28 10:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-28 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_8da0e49b89e882ebba2d6df8773986e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_403360131a5b9924d8aa8c4f76f1df58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_82e8e3982a40e893d5fc26800361066d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd61e0b0d0>
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_8da0e49b89e882ebba2d6df8773986e1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_8da0e49b89e882ebba2d6df8773986e1.jpg saved to cache
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_87784f5066e581eed469864a2f4e678b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd555daa10>
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_403360131a5b9924d8aa8c4f76f1df58.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_403360131a5b9924d8aa8c4f76f1df58.jpg saved to cache
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f788550>
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_82e8e3982a40e893d5fc26800361066d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_82e8e3982a40e893d5fc26800361066d.jpg saved to cache
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55675050>
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_87784f5066e581eed469864a2f4e678b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_87784f5066e581eed469864a2f4e678b.jpg saved to cache
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b050a15940d4422c5c2501b91b30e08d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_03434b659afafb160baaaa37284dc902.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_5a530108ae3b6c2905081dc2517cc10c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f59d310>
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4d%252F8e4d82f22cdc147f36dbe3c9b604bcba%252Fpa%252FKW07987_b050a15940d4422c5c2501b91b30e08d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b050a15940d4422c5c2501b91b30e08d.jpg saved to cache
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc3caa2-5686-523e-90f6-99682665dcf9
2026-03-28 10:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc3caa2-5686-523e-90f6-99682665dcf9, skipping ID generation
2026-03-28 10:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 1
2026-03-28 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc3caa2-5686-523e-90f6-99682665dcf9 sending to next pipeline
2026-03-28 10:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc3caa2-5686-523e-90f6-99682665dcf9, identifier: KW07987
2026-03-28 10:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-28 10:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-28 10:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987 to the API
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b050a15940d4422c5c2501b91b30e08d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'diesel',
 'id': '4cc3caa2-5686-523e-90f6-99682665dcf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW07987',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 180923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b050a15940d4422c5c2501b91b30e08d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_63ed1db5811592da3ff23b7fe8a75aa8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_90cde8c67694df974fa4e9bf1e8f4a0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_a2e0fc70084cedfa39d73c88e6f18f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564672,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_09ad0e2ce55e28d9a6e03cac4e9f071b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_65670d209dbedd5c2082590132e72c8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2310330,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_1e1a80e2bc12c609e7f23539e3ce7382.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_b7be5d8f2b351ab9713a582dbf0f9097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_7d82a1bce029806d7b518e351c85c353.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc3caa2-5686-523e-90f6-99682665dcf9/4cc3caa2-5686-523e-90f6-99682665dcf9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2267399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4d/8e4d82f22cdc147f36dbe3c9b604bcba/pa/KW07987_341d6f13439b676a4a4ab7a8adb18cba.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-28 10:34:09 [auto1.de] INFO: Saving data for KW07987: {'created_time': 1774694049.078762, 'last_price_update_time': 1774694049.078774, 'auction_closing_time': 1774886120.0}
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW07987') HTTP/1.1" 204 0
2026-03-28 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA67550> (referer: https://www.auto1.com/v1/car-details-view/CA67550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f571b90>
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_03434b659afafb160baaaa37284dc902.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_03434b659afafb160baaaa37284dc902.jpg saved to cache
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f66e410>
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_5a530108ae3b6c2905081dc2517cc10c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_5a530108ae3b6c2905081dc2517cc10c.jpg saved to cache
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec8cb90>
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb8%252F6bb8067e114b55e03c0353308f14e1ed%252Fpa%252FTS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg saved to cache
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5
2026-03-28 10:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5, skipping ID generation
2026-03-28 10:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 1
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 sending to next pipeline
2026-03-28 10:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5, identifier: TS47391
2026-03-28 10:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-28 10:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 1
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_18db50d9e6a5f6f404f599438f98baaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_18db50d9e6a5f6f404f599438f98baaf.jpg not downloaded yet
2026-03-28 10:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-28 10:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-28 10:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391 to the API
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:20Z',
 'fuel_type': 'petrol',
 'id': '9e074c97-29bd-5eb9-b797-cf5e32b11eb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47391',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 148785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_85aab57839ff08f2cfbba7994c64eb47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_03434b659afafb160baaaa37284dc902.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_022c6e60cd1c2dabd11784d4cf31cc2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2933238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_5a530108ae3b6c2905081dc2517cc10c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3132959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_87784f5066e581eed469864a2f4e678b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_f6539d2bc39520556154ffac632b24c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2185028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_d9980bc303ea7b631a43a2b6b50ed410.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_403360131a5b9924d8aa8c4f76f1df58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_82e8e3982a40e893d5fc26800361066d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e074c97-29bd-5eb9-b797-cf5e32b11eb5/9e074c97-29bd-5eb9-b797-cf5e32b11eb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2956767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b8/6bb8067e114b55e03c0353308f14e1ed/pa/TS47391_8da0e49b89e882ebba2d6df8773986e1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-28 10:34:09 [auto1.de] INFO: Saving data for TS47391: {'created_time': 1774694049.978348, 'last_price_update_time': 1774694049.978363, 'auction_closing_time': 1774885520.0}
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS47391') HTTP/1.1" 204 0
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_51f6796d72bff83b87cab539f927e878.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f6796d72bff83b87cab539f927e878.jpg not downloaded yet
2026-03-28 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_fa72e335a627cd1690ea04e0014547d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_fa72e335a627cd1690ea04e0014547d6.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_3084f953ad1211220d530381cc5fe713.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3084f953ad1211220d530381cc5fe713.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_3f3ba653690d771a552e749ca17b59cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3f3ba653690d771a552e749ca17b59cf.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg not downloaded yet
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_c9acc86534156eeee5ed1891f3e51a27.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_c9acc86534156eeee5ed1891f3e51a27.jpg not downloaded yet
2026-03-28 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec8c050>
2026-03-28 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F48%252F3c4885eb082beedfd271ae619660eff5%252Fpa%252FHA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg saved to cache
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe
2026-03-28 10:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe, skipping ID generation
2026-03-28 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 1
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe sending to next pipeline
2026-03-28 10:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe, identifier: HA56884
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_871a66d54a703cad669eb0c2f62d2a00.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_871a66d54a703cad669eb0c2f62d2a00.jpg not downloaded yet
2026-03-28 10:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-28 10:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-28 10:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884 to the API
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:43Z',
 'fuel_type': 'petrol',
 'id': '54e674f2-ef7a-5dc7-8567-a348a4a1f7fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA56884',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 124438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_fbbd4e77b9aaa78cd3389d3086d75efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9370d6d3782410502b0de968c59f081b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_9d64f513789379a9a5c7485b64134be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_94f50e6892f9453daae3557f4a170626.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e674f2-ef7a-5dc7-8567-a348a4a1f7fe/54e674f2-ef7a-5dc7-8567-a348a4a1f7fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/48/3c4885eb082beedfd271ae619660eff5/pa/HA56884_3cb2ef648c83b8158345e587f7929079.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Roland Garros',
 'transmission': 'manual',
 'trim': 'Roland Garros',
 'year': 2012}
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [auto1.de] INFO: Saving data for HA56884: {'created_time': 1774694050.638559, 'last_price_update_time': 1774694050.63857, 'auction_closing_time': 1774885303.0}
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA56884') HTTP/1.1" 204 0
2026-03-28 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA52308> (referer: https://www.auto1.com/v1/car-details-view/EA52308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f6796d72bff83b87cab539f927e878.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-28 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e849fe6-7241-5809-921f-b47784246f31 with scrape type 1
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e849fe6-7241-5809-921f-b47784246f31
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_90ea9fb79c174e8518ced907486ed14b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_90ea9fb79c174e8518ced907486ed14b.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_0f53b29fab4640b9afb49f0d613d0d06.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_0f53b29fab4640b9afb49f0d613d0d06.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_6e63e112b104e77fbd4af4e2dd2fe094.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_6e63e112b104e77fbd4af4e2dd2fe094.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_10b8efe0ecd038ae88ea7c14e5b07b12.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_10b8efe0ecd038ae88ea7c14e5b07b12.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_4088103afe49e543aa43c3efe853bd2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_4088103afe49e543aa43c3efe853bd2b.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_8a804006f882ca525b058cbfa2fc77c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_8a804006f882ca525b058cbfa2fc77c9.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_c94275fbbcb2f65d311e99f58dd445ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_c94275fbbcb2f65d311e99f58dd445ee.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_98ddc610fe6cc48055551fb59c7b6f4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_98ddc610fe6cc48055551fb59c7b6f4b.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_ae57f6d6ee65563edfcecae75f036c15.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_ae57f6d6ee65563edfcecae75f036c15.jpg already downloaded
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bef2a55211a822477162910150cfb8%252Fpa%252FEA52308_389b627a6ae23026c0ec0a246e128843.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_389b627a6ae23026c0ec0a246e128843.jpg already downloaded
2026-03-28 10:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e849fe6-7241-5809-921f-b47784246f31, identifier: EA52308
2026-03-28 10:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-28 10:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-28 10:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308 to the API
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA52308>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:42Z',
 'fuel_type': 'diesel',
 'id': '8e849fe6-7241-5809-921f-b47784246f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA52308',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_90ea9fb79c174e8518ced907486ed14b.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_0f53b29fab4640b9afb49f0d613d0d06.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_6e63e112b104e77fbd4af4e2dd2fe094.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_10b8efe0ecd038ae88ea7c14e5b07b12.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_4088103afe49e543aa43c3efe853bd2b.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_8a804006f882ca525b058cbfa2fc77c9.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_c94275fbbcb2f65d311e99f58dd445ee.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_98ddc610fe6cc48055551fb59c7b6f4b.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_ae57f6d6ee65563edfcecae75f036c15.jpg',
                'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_389b627a6ae23026c0ec0a246e128843.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_90ea9fb79c174e8518ced907486ed14b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_0f53b29fab4640b9afb49f0d613d0d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_6e63e112b104e77fbd4af4e2dd2fe094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_10b8efe0ecd038ae88ea7c14e5b07b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_4088103afe49e543aa43c3efe853bd2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_8a804006f882ca525b058cbfa2fc77c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_c94275fbbcb2f65d311e99f58dd445ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_98ddc610fe6cc48055551fb59c7b6f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_ae57f6d6ee65563edfcecae75f036c15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e849fe6-7241-5809-921f-b47784246f31/8e849fe6-7241-5809-921f-b47784246f31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bef2a55211a822477162910150cfb8/pa/EA52308_389b627a6ae23026c0ec0a246e128843.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-28 10:34:11 [auto1.de] INFO: Saving data for EA52308: {'created_time': 1774694051.400092, 'last_price_update_time': 1774694051.400103, 'auction_closing_time': 1774885182.0}
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA52308') HTTP/1.1" 204 0
2026-03-28 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_871a66d54a703cad669eb0c2f62d2a00.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_c9acc86534156eeee5ed1891f3e51a27.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec08150>
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_51f6796d72bff83b87cab539f927e878.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f6796d72bff83b87cab539f927e878.jpg saved to cache
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f564d50>
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_871a66d54a703cad669eb0c2f62d2a00.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_871a66d54a703cad669eb0c2f62d2a00.jpg saved to cache
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd5563a2d0>
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_c9acc86534156eeee5ed1891f3e51a27.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_c9acc86534156eeee5ed1891f3e51a27.jpg saved to cache
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f787a10>
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg saved to cache
2026-03-28 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3f3ba653690d771a552e749ca17b59cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6b5350>
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg saved to cache
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f569910>
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_3f3ba653690d771a552e749ca17b59cf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3f3ba653690d771a552e749ca17b59cf.jpg saved to cache
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a12d0>
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg saved to cache
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3084f953ad1211220d530381cc5fe713.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA22909> (referer: https://www.auto1.com/v1/car-details-view/DA22909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_18db50d9e6a5f6f404f599438f98baaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a1750>
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_3084f953ad1211220d530381cc5fe713.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3084f953ad1211220d530381cc5fe713.jpg saved to cache
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV20886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-28 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 1
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg not downloaded yet
2026-03-28 10:34:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5ba890>
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_18db50d9e6a5f6f404f599438f98baaf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_18db50d9e6a5f6f404f599438f98baaf.jpg saved to cache
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_9860606cfc06938d427f6769eedc173d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_9860606cfc06938d427f6769eedc173d.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_96ba80a0541212321a2f1d042172603a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_96ba80a0541212321a2f1d042172603a.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_7010f8bc8b316ff26e650ea9f078928a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_7010f8bc8b316ff26e650ea9f078928a.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_8aec290c5ad42b59574c8b757d29f835.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_8aec290c5ad42b59574c8b757d29f835.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg not downloaded yet
2026-03-28 10:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_fa72e335a627cd1690ea04e0014547d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_eb1868bb7140475d306a50a8bfa56eee.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_eb1868bb7140475d306a50a8bfa56eee.jpg not downloaded yet
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_04d0383b79e73ccf917da131b302daa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_04d0383b79e73ccf917da131b302daa0.jpg not downloaded yet
2026-03-28 10:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e5f50>
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F17%252F6d179f1b9105fe2ac003adff7c2b74fb%252Fpa%252FCA67550_fa72e335a627cd1690ea04e0014547d6.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_fa72e335a627cd1690ea04e0014547d6.jpg saved to cache
2026-03-28 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e
2026-03-28 10:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb41ac90-c3b7-5844-82da-020b8dbc5e1e, skipping ID generation
2026-03-28 10:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 1
2026-03-28 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e sending to next pipeline
2026-03-28 10:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb41ac90-c3b7-5844-82da-020b8dbc5e1e, identifier: CA67550
2026-03-28 10:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-28 10:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-28 10:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550 to the API
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_fa72e335a627cd1690ea04e0014547d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'petrol',
 'id': 'eb41ac90-c3b7-5844-82da-020b8dbc5e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA67550',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 98353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_18db50d9e6a5f6f404f599438f98baaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f6796d72bff83b87cab539f927e878.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_fa72e335a627cd1690ea04e0014547d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3084f953ad1211220d530381cc5fe713.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_eec169b7596322e8bfc6d815e80ce4fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_3f3ba653690d771a552e749ca17b59cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3156234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_93912e861adc641bdf4bbc47fea4d3d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_51f9f4fa60a95bd2ceaed536dba3e7dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_c9acc86534156eeee5ed1891f3e51a27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb41ac90-c3b7-5844-82da-020b8dbc5e1e/eb41ac90-c3b7-5844-82da-020b8dbc5e1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/17/6d179f1b9105fe2ac003adff7c2b74fb/pa/CA67550_871a66d54a703cad669eb0c2f62d2a00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-28 10:34:13 [auto1.de] INFO: Saving data for CA67550: {'created_time': 1774694053.661458, 'last_price_update_time': 1774694053.66147, 'auction_closing_time': 1774885729.0}
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA67550') HTTP/1.1" 204 0
2026-03-28 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_8aec290c5ad42b59574c8b757d29f835.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f676950>
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_8aec290c5ad42b59574c8b757d29f835.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_8aec290c5ad42b59574c8b757d29f835.jpg saved to cache
2026-03-28 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK14391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_04d0383b79e73ccf917da131b302daa0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2db10>
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_04d0383b79e73ccf917da131b302daa0.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_04d0383b79e73ccf917da131b302daa0.jpg saved to cache
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_eb1868bb7140475d306a50a8bfa56eee.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f65e350>
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_eb1868bb7140475d306a50a8bfa56eee.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_eb1868bb7140475d306a50a8bfa56eee.jpg saved to cache
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f786590>
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg saved to cache
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f58f4d0>
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg saved to cache
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_7010f8bc8b316ff26e650ea9f078928a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e6fd0>
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_7010f8bc8b316ff26e650ea9f078928a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_7010f8bc8b316ff26e650ea9f078928a.jpg saved to cache
2026-03-28 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56b810>
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg saved to cache
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK87241> (referer: https://www.auto1.com/v1/car-details-view/UK87241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-28 10:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 1
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_bd2b3410546031f5ce801bacc6a671af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_bd2b3410546031f5ce801bacc6a671af.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_60760401e685be49dd2bbb249dc5e8a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_60760401e685be49dd2bbb249dc5e8a6.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_b99383daf942e0949706ad9e01b2e668.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_b99383daf942e0949706ad9e01b2e668.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_9742a863b15a53b265101b2684cae03d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_9742a863b15a53b265101b2684cae03d.jpg not downloaded yet
2026-03-28 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_96ba80a0541212321a2f1d042172603a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b9b90>
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_96ba80a0541212321a2f1d042172603a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_96ba80a0541212321a2f1d042172603a.jpg saved to cache
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_9742a863b15a53b265101b2684cae03d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF10429> (referer: https://www.auto1.com/v1/car-details-view/BF10429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7527d0>
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_9742a863b15a53b265101b2684cae03d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_9742a863b15a53b265101b2684cae03d.jpg saved to cache
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-28 10:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 1
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_c26c0e20c7db1ee987304a1860777f92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_c26c0e20c7db1ee987304a1860777f92.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg not downloaded yet
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg not downloaded yet
2026-03-28 10:34:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd557867d0>
2026-03-28 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg saved to cache
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY39038> (referer: https://www.auto1.com/v1/car-details-view/ZY39038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg not downloaded yet
2026-03-28 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_d59715daf63323028178c56b1b7d0452.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_d59715daf63323028178c56b1b7d0452.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_012a04934610a83cb21229c4bfd1bb58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_012a04934610a83cb21229c4bfd1bb58.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_67edd973bd6a1c8e804377aa5df015b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_67edd973bd6a1c8e804377aa5df015b6.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg not downloaded yet
2026-03-28 10:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-28 10:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 1
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_893f348274e4acc0bec4e44390274a15.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_893f348274e4acc0bec4e44390274a15.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB79072> (referer: https://www.auto1.com/v1/car-details-view/FB79072/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg not downloaded yet
2026-03-28 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_57e85b16a50c0dee4495312c49036fd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_57e85b16a50c0dee4495312c49036fd5.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_db178a0d23c277d462f0b94ba24444a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_db178a0d23c277d462f0b94ba24444a5.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg not downloaded yet
2026-03-28 10:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-28 10:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 1
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_4304d8202547da11efb0bdb90f38d1d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_4304d8202547da11efb0bdb90f38d1d5.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg not downloaded yet
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a7ed0>
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg saved to cache
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_b99383daf942e0949706ad9e01b2e668.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_d04f776557aaedbe6d84920e32119c14.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_d04f776557aaedbe6d84920e32119c14.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_c49d81845606917b580fbebb184bff62.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_c49d81845606917b580fbebb184bff62.jpg not downloaded yet
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY71036> (referer: https://www.auto1.com/v1/car-details-view/GY71036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd5562c550>
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg saved to cache
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_b1b4758aaea260acd662524096b8e1f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_b1b4758aaea260acd662524096b8e1f2.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg not downloaded yet
2026-03-28 10:34:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f65dc90>
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_b99383daf942e0949706ad9e01b2e668.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_b99383daf942e0949706ad9e01b2e668.jpg saved to cache
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-28 10:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 1
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_c38d008e7bfd457d98dd293071ff4c21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_c38d008e7bfd457d98dd293071ff4c21.jpg not downloaded yet
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_48a61c6d66d238fbee344da211ad56b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_48a61c6d66d238fbee344da211ad56b2.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_3558d30ebd328a675d276141c17c75a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_3558d30ebd328a675d276141c17c75a1.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_1074fde9640a204de92a57a8140e899a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_1074fde9640a204de92a57a8140e899a.jpg not downloaded yet
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA88960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_01a71630608e6c42183316425b58203f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_01a71630608e6c42183316425b58203f.jpg not downloaded yet
2026-03-28 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7d90d0>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_66ed060903754e0a98d25def0d950077.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_66ed060903754e0a98d25def0d950077.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_7b2314ab6858c64129785e2b1531727a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_7b2314ab6858c64129785e2b1531727a.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_1cdeace358610be80310a2a775954ea7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_1cdeace358610be80310a2a775954ea7.jpg not downloaded yet
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_c49d81845606917b580fbebb184bff62.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_795e5aee8671bc5803caa585983fd7f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_795e5aee8671bc5803caa585983fd7f1.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_ec680b5922a8904b33021d06a094e172.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_ec680b5922a8904b33021d06a094e172.jpg not downloaded yet
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_90600a4d90e49cabc7455549d286de40.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_90600a4d90e49cabc7455549d286de40.jpg not downloaded yet
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY64053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_b1b4758aaea260acd662524096b8e1f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a74d0>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_c49d81845606917b580fbebb184bff62.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_c49d81845606917b580fbebb184bff62.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f604a10>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_d04f776557aaedbe6d84920e32119c14.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a0e10>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f776090>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_b1b4758aaea260acd662524096b8e1f2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_b1b4758aaea260acd662524096b8e1f2.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_90600a4d90e49cabc7455549d286de40.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6dfb50>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_d04f776557aaedbe6d84920e32119c14.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_d04f776557aaedbe6d84920e32119c14.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec3cb10>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7daf90>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_90600a4d90e49cabc7455549d286de40.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_90600a4d90e49cabc7455549d286de40.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD36788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_1074fde9640a204de92a57a8140e899a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_ec680b5922a8904b33021d06a094e172.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD09354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_795e5aee8671bc5803caa585983fd7f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7a6510>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_1074fde9640a204de92a57a8140e899a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_1074fde9640a204de92a57a8140e899a.jpg saved to cache
2026-03-28 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_7b2314ab6858c64129785e2b1531727a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_66ed060903754e0a98d25def0d950077.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF20079> (referer: https://www.auto1.com/v1/car-details-view/BF20079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_3558d30ebd328a675d276141c17c75a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_01a71630608e6c42183316425b58203f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6b8d50>
2026-03-28 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_ec680b5922a8904b33021d06a094e172.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_ec680b5922a8904b33021d06a094e172.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f676fd0>
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_795e5aee8671bc5803caa585983fd7f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_795e5aee8671bc5803caa585983fd7f1.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH86831> (referer: https://www.auto1.com/v1/car-details-view/YH86831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f671010>
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_7b2314ab6858c64129785e2b1531727a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_7b2314ab6858c64129785e2b1531727a.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2bd10>
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_66ed060903754e0a98d25def0d950077.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_66ed060903754e0a98d25def0d950077.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-28 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 1
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg not downloaded yet
2026-03-28 10:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3d4d0>
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_3558d30ebd328a675d276141c17c75a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_3558d30ebd328a675d276141c17c75a1.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b3a90>
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_01a71630608e6c42183316425b58203f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_01a71630608e6c42183316425b58203f.jpg saved to cache
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_229ed88017e93f15a38ddb9c3658aec1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_229ed88017e93f15a38ddb9c3658aec1.jpg not downloaded yet
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK14391> (referer: https://www.auto1.com/v1/car-details-view/NK14391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-28 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 1
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_f06aa17fc3190d3e5de5d20892fea293.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_f06aa17fc3190d3e5de5d20892fea293.jpg not downloaded yet
2026-03-28 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_aa81c973a45de197d23e2c2416c71967.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_aa81c973a45de197d23e2c2416c71967.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_90affb3617511ff601f42877a64440f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_90affb3617511ff601f42877a64440f5.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_547da11f98537c25215fbd1f7b4d0055.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_547da11f98537c25215fbd1f7b4d0055.jpg not downloaded yet
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_4304d8202547da11efb0bdb90f38d1d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_3f51df2a51914620246740c6943e5cb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_3f51df2a51914620246740c6943e5cb7.jpg not downloaded yet
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_c89a49e76a92c154bc128aaf2c746d96.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c89a49e76a92c154bc128aaf2c746d96.jpg not downloaded yet
2026-03-28 10:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-28 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 1
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_4a2bf035d4d36e18c993d1319da99caa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_4a2bf035d4d36e18c993d1319da99caa.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg not downloaded yet
2026-03-28 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_1cdeace358610be80310a2a775954ea7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_f30125c17b48f708946a7baf031c4008.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_f30125c17b48f708946a7baf031c4008.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_37d48101c5cac4e6eed15a32872b8a63.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_37d48101c5cac4e6eed15a32872b8a63.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_a7fd7dc38f386c69476b90833835f4ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_a7fd7dc38f386c69476b90833835f4ef.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_dc26022745e826fed7df5448249f0858.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_dc26022745e826fed7df5448249f0858.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg not downloaded yet
2026-03-28 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg not downloaded yet
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb4dd10>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_4304d8202547da11efb0bdb90f38d1d5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_4304d8202547da11efb0bdb90f38d1d5.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f9590>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd3c90>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_1b707c2a164ea11da4010a855ccfc562.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_1b707c2a164ea11da4010a855ccfc562.jpg not downloaded yet
2026-03-28 10:34:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.346(s), this was the 1st time calling it.
2026-03-28 10:34:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.768021666336249 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_547da11f98537c25215fbd1f7b4d0055.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_0496ea876b071009823bc16c0d075bbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0496ea876b071009823bc16c0d075bbf.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg not downloaded yet
2026-03-28 10:34:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebcf750>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_1cdeace358610be80310a2a775954ea7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_1cdeace358610be80310a2a775954ea7.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_90affb3617511ff601f42877a64440f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_aa81c973a45de197d23e2c2416c71967.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_36b55cd50e96050d4a6f76d28798ccec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_36b55cd50e96050d4a6f76d28798ccec.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_c968e4795ffb78827235b81863080b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c968e4795ffb78827235b81863080b21.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY64053> (referer: https://www.auto1.com/v1/car-details-view/EY64053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb99590>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_547da11f98537c25215fbd1f7b4d0055.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_547da11f98537c25215fbd1f7b4d0055.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_88e5627d1e9450401fba4344077f5011.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_88e5627d1e9450401fba4344077f5011.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_48a61c6d66d238fbee344da211ad56b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_1b707c2a164ea11da4010a855ccfc562.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd49d0>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_90affb3617511ff601f42877a64440f5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_90affb3617511ff601f42877a64440f5.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55915c90>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_aa81c973a45de197d23e2c2416c71967.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_aa81c973a45de197d23e2c2416c71967.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-28 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 1
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_af894bd6e990565fb13435d1755b1b2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_af894bd6e990565fb13435d1755b1b2a.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_a1adf70002ae4ffbaa1090062ea34213.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_a1adf70002ae4ffbaa1090062ea34213.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA88960> (referer: https://www.auto1.com/v1/car-details-view/HA88960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_f17756c79813ba2166827be1f0881486.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_f17756c79813ba2166827be1f0881486.jpg not downloaded yet
2026-03-28 10:34:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f580410>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_48a61c6d66d238fbee344da211ad56b2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_48a61c6d66d238fbee344da211ad56b2.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5bbe90>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_1b707c2a164ea11da4010a855ccfc562.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_1b707c2a164ea11da4010a855ccfc562.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_36b55cd50e96050d4a6f76d28798ccec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_88e5627d1e9450401fba4344077f5011.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV20886> (referer: https://www.auto1.com/v1/car-details-view/CV20886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD09354> (referer: https://www.auto1.com/v1/car-details-view/AD09354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM85402> (referer: https://www.auto1.com/v1/car-details-view/BM85402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5720d0>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecda210>
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg saved to cache
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-28 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 1
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_ea40085b3212fa0a4a4378288acab0a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_ea40085b3212fa0a4a4378288acab0a9.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_3339605282f2fc5d8e6c25c79a491d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_3339605282f2fc5d8e6c25c79a491d75.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_9709f4f1949fafd879f0e5ca65905253.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_9709f4f1949fafd879f0e5ca65905253.jpg not downloaded yet
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_755bb10186a449c06dc439f67c0d36c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_755bb10186a449c06dc439f67c0d36c8.jpg not downloaded yet
2026-03-28 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_a1adf70002ae4ffbaa1090062ea34213.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_c2f8240efc74dba13848fc190d63ab8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_c2f8240efc74dba13848fc190d63ab8a.jpg not downloaded yet
2026-03-28 10:34:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b02d0>
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F0e%252Ffd0e767c63279f00b22e75d10d782efc%252Fpa%252FFB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg saved to cache
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb
2026-03-28 10:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb, skipping ID generation
2026-03-28 10:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 1
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb sending to next pipeline
2026-03-28 10:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb, identifier: FB79072
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf8450>
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_36b55cd50e96050d4a6f76d28798ccec.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_36b55cd50e96050d4a6f76d28798ccec.jpg saved to cache
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5c0bd0>
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_88e5627d1e9450401fba4344077f5011.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_88e5627d1e9450401fba4344077f5011.jpg saved to cache
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-28 10:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 1
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg not downloaded yet
2026-03-28 10:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-28 10:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 1
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_e8b72024d771324178be9651fc194d44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_e8b72024d771324178be9651fc194d44.jpg not downloaded yet
2026-03-28 10:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-28 10:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 1
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg not downloaded yet
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec13490>
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg saved to cache
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_f17756c79813ba2166827be1f0881486.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg not downloaded yet
2026-03-28 10:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:34:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-28 10:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072 to the API
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:06Z',
 'fuel_type': 'diesel',
 'id': 'eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB79072',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 231923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2031808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_741f09bcb0b79ee7ddc9461f272e2783.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_4304d8202547da11efb0bdb90f38d1d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2041945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_fd0a47f63cf579eb90ba8c615ada0443.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_ea85f0dcd3df55c218a6d681d6bb3322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_d04f776557aaedbe6d84920e32119c14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_c49d81845606917b580fbebb184bff62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1951144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_b1b4758aaea260acd662524096b8e1f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_959377ccab0ea7d8c19c53b92d5872fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2003324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_48a61c6d66d238fbee344da211ad56b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb/eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2052898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/0e/fd0e767c63279f00b22e75d10d782efc/pa/FB79072_1074fde9640a204de92a57a8140e899a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [auto1.de] INFO: Saving data for FB79072: {'created_time': 1774694061.48237, 'last_price_update_time': 1774694061.48238, 'auction_closing_time': 1774885086.0}
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB79072') HTTP/1.1" 204 0
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_4cdf5143260644c05d184931bb6cc81f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_4cdf5143260644c05d184931bb6cc81f.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_8ee3d506956cc2445b90a850d2a85eda.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_8ee3d506956cc2445b90a850d2a85eda.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg not downloaded yet
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0496ea876b071009823bc16c0d075bbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_d7d516ac467a33c505f3f07366d15d33.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_d7d516ac467a33c505f3f07366d15d33.jpg not downloaded yet
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD36788> (referer: https://www.auto1.com/v1/car-details-view/YD36788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH64159> (referer: https://www.auto1.com/v1/car-details-view/MH64159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_dc26022745e826fed7df5448249f0858.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_41149eec7756495c7240cb9f6b13ba7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_41149eec7756495c7240cb9f6b13ba7f.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_da814af000f20a11e679095d4029572e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_da814af000f20a11e679095d4029572e.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_6988431f741b894226080810817cc8f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_6988431f741b894226080810817cc8f8.jpg not downloaded yet
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd4710>
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_a1adf70002ae4ffbaa1090062ea34213.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_a1adf70002ae4ffbaa1090062ea34213.jpg saved to cache
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd7010>
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_f17756c79813ba2166827be1f0881486.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_f17756c79813ba2166827be1f0881486.jpg saved to cache
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_3894f98d61e24f23ed2d021718d4eb74.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3894f98d61e24f23ed2d021718d4eb74.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_8a36f35a820c04a0bedf67d247b85b04.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_8a36f35a820c04a0bedf67d247b85b04.jpg not downloaded yet
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_c38d008e7bfd457d98dd293071ff4c21.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_3e3fd000580843e101f7ceeb37fed04f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3e3fd000580843e101f7ceeb37fed04f.jpg not downloaded yet
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_79c228de2f04985e603114c553eeeff8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_79c228de2f04985e603114c553eeeff8.jpg not downloaded yet
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3fb50>
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_0496ea876b071009823bc16c0d075bbf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0496ea876b071009823bc16c0d075bbf.jpg saved to cache
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-28 10:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 1
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg not downloaded yet
2026-03-28 10:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-28 10:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with scrape type 1
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F61%252F786174423895c88f0b4bcdaf9d5da553%252Fpa%252FMH64159_f3f58b73bfbb44ae44eab7397ee126b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_f3f58b73bfbb44ae44eab7397ee126b7.jpg already downloaded
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F61%252F786174423895c88f0b4bcdaf9d5da553%252Fpa%252FMH64159_9b1f4dece90593fb7f8c4808281ed510.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_9b1f4dece90593fb7f8c4808281ed510.jpg already downloaded
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F61%252F786174423895c88f0b4bcdaf9d5da553%252Fpa%252FMH64159_0fd72406a54fca2324b3edc569d1f191.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_0fd72406a54fca2324b3edc569d1f191.jpg already downloaded
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F61%252F786174423895c88f0b4bcdaf9d5da553%252Fpa%252FMH64159_a4af337d7c078c46753e56ac06f674ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_a4af337d7c078c46753e56ac06f674ac.jpg already downloaded
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F61%252F786174423895c88f0b4bcdaf9d5da553%252Fpa%252FMH64159_c5f1919b40b4b7d3b9492a14720427f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_c5f1919b40b4b7d3b9492a14720427f5.jpg already downloaded
2026-03-28 10:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b903a51-3219-55ce-8cbc-ffc7d2caa415, identifier: MH64159
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f753ad0>
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_dc26022745e826fed7df5448249f0858.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_dc26022745e826fed7df5448249f0858.jpg saved to cache
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-28 10:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-28 10:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159 to the API
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH64159>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'petrol',
 'id': '7b903a51-3219-55ce-8cbc-ffc7d2caa415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH64159',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 62072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_f3f58b73bfbb44ae44eab7397ee126b7.jpg',
                'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_9b1f4dece90593fb7f8c4808281ed510.jpg',
                'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_0fd72406a54fca2324b3edc569d1f191.jpg',
                'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_a4af337d7c078c46753e56ac06f674ac.jpg',
                'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_c5f1919b40b4b7d3b9492a14720427f5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b903a51-3219-55ce-8cbc-ffc7d2caa415/7b903a51-3219-55ce-8cbc-ffc7d2caa415_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_f3f58b73bfbb44ae44eab7397ee126b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b903a51-3219-55ce-8cbc-ffc7d2caa415/7b903a51-3219-55ce-8cbc-ffc7d2caa415_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_9b1f4dece90593fb7f8c4808281ed510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b903a51-3219-55ce-8cbc-ffc7d2caa415/7b903a51-3219-55ce-8cbc-ffc7d2caa415_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_0fd72406a54fca2324b3edc569d1f191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b903a51-3219-55ce-8cbc-ffc7d2caa415/7b903a51-3219-55ce-8cbc-ffc7d2caa415_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_a4af337d7c078c46753e56ac06f674ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b903a51-3219-55ce-8cbc-ffc7d2caa415/7b903a51-3219-55ce-8cbc-ffc7d2caa415_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/61/786174423895c88f0b4bcdaf9d5da553/pa/MH64159_c5f1919b40b4b7d3b9492a14720427f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Chiemsee',
 'transmission': 'manual',
 'trim': 'Chiemsee',
 'year': 2002}
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [auto1.de] INFO: Saving data for MH64159: {'created_time': 1774694062.558846, 'last_price_update_time': 1774694062.558861, 'auction_closing_time': 1774886220.0}
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH64159') HTTP/1.1" 204 0
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_6394d55552fa58af63d8b2b5818c3bef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_6394d55552fa58af63d8b2b5818c3bef.jpg not downloaded yet
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_28919b98b9205b08093015668ca160a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_28919b98b9205b08093015668ca160a4.jpg not downloaded yet
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_fc521578d3e5666c1ced4af32da71dfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_fc521578d3e5666c1ced4af32da71dfa.jpg not downloaded yet
2026-03-28 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_a7fd7dc38f386c69476b90833835f4ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebcf550>
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffb%252F9ffb4be0c36deb98d5ad289bf4824833%252Fpa%252FGY71036_c38d008e7bfd457d98dd293071ff4c21.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_c38d008e7bfd457d98dd293071ff4c21.jpg saved to cache
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1449c7c0-88ed-558a-b35c-64f012161f92
2026-03-28 10:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1449c7c0-88ed-558a-b35c-64f012161f92, skipping ID generation
2026-03-28 10:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 1
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1449c7c0-88ed-558a-b35c-64f012161f92 sending to next pipeline
2026-03-28 10:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1449c7c0-88ed-558a-b35c-64f012161f92, identifier: GY71036
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb28d10>
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg saved to cache
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_9709f4f1949fafd879f0e5ca65905253.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_c6731109a5f588a84a6f9100e98c99c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c6731109a5f588a84a6f9100e98c99c8.jpg not downloaded yet
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_457544f87e5ae1e542364d754e0f34f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_457544f87e5ae1e542364d754e0f34f4.jpg not downloaded yet
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg not downloaded yet
2026-03-28 10:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-28 10:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-28 10:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036 to the API
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_c38d008e7bfd457d98dd293071ff4c21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:32:52Z',
 'fuel_type': 'petrol',
 'id': '1449c7c0-88ed-558a-b35c-64f012161f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY71036',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 41702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_c38d008e7bfd457d98dd293071ff4c21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_3558d30ebd328a675d276141c17c75a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_01a71630608e6c42183316425b58203f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_66ed060903754e0a98d25def0d950077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_7b2314ab6858c64129785e2b1531727a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_93b204b35b4eff8a446d0d364d3bbb11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_1cdeace358610be80310a2a775954ea7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_795e5aee8671bc5803caa585983fd7f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_ec680b5922a8904b33021d06a094e172.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1449c7c0-88ed-558a-b35c-64f012161f92/1449c7c0-88ed-558a-b35c-64f012161f92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/fb/9ffb4be0c36deb98d5ad289bf4824833/pa/GY71036_90600a4d90e49cabc7455549d286de40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Intro Edition+',
 'transmission': 'manual',
 'trim': 'Intro Edition+',
 'year': 2020}
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [auto1.de] INFO: Saving data for GY71036: {'created_time': 1774694063.367726, 'last_price_update_time': 1774694063.367738, 'auction_closing_time': 1774884772.0}
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY71036') HTTP/1.1" 204 0
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea22610>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg not downloaded yet
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_3debd2448105ba123977bf0db48fc722.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3debd2448105ba123977bf0db48fc722.jpg not downloaded yet
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg not downloaded yet
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg not downloaded yet
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg not downloaded yet
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_84f2003a8307d44921c9af017bceff2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_84f2003a8307d44921c9af017bceff2e.jpg not downloaded yet
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec8ef90>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_a7fd7dc38f386c69476b90833835f4ef.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_a7fd7dc38f386c69476b90833835f4ef.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6a18d0>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_9709f4f1949fafd879f0e5ca65905253.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_9709f4f1949fafd879f0e5ca65905253.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_d7d516ac467a33c505f3f07366d15d33.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg not downloaded yet
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_98c266be406d002913506b7d33a31e25.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_98c266be406d002913506b7d33a31e25.jpg not downloaded yet
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca55d0>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_229ed88017e93f15a38ddb9c3658aec1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd559d7e10>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55659750>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa9590>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_d7d516ac467a33c505f3f07366d15d33.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_d7d516ac467a33c505f3f07366d15d33.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c968e4795ffb78827235b81863080b21.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_8a36f35a820c04a0bedf67d247b85b04.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f67d1d0>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_229ed88017e93f15a38ddb9c3658aec1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_229ed88017e93f15a38ddb9c3658aec1.jpg saved to cache
2026-03-28 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f572d10>
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_fc521578d3e5666c1ced4af32da71dfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb14bd0>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_c968e4795ffb78827235b81863080b21.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c968e4795ffb78827235b81863080b21.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb39690>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_8a36f35a820c04a0bedf67d247b85b04.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_8a36f35a820c04a0bedf67d247b85b04.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd5561bc50>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7a43d0>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6c2b10>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_84f2003a8307d44921c9af017bceff2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea721d0>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_fc521578d3e5666c1ced4af32da71dfa.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_fc521578d3e5666c1ced4af32da71dfa.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55915f10>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_af894bd6e990565fb13435d1755b1b2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec8f590>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb15fd0>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_84f2003a8307d44921c9af017bceff2e.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_84f2003a8307d44921c9af017bceff2e.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3debd2448105ba123977bf0db48fc722.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_37d48101c5cac4e6eed15a32872b8a63.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6bb490>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_af894bd6e990565fb13435d1755b1b2a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_af894bd6e990565fb13435d1755b1b2a.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c6731109a5f588a84a6f9100e98c99c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea57e90>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecd5210>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2d190>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_3debd2448105ba123977bf0db48fc722.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3debd2448105ba123977bf0db48fc722.jpg saved to cache
2026-03-28 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2e950>
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_37d48101c5cac4e6eed15a32872b8a63.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_37d48101c5cac4e6eed15a32872b8a63.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec00590>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_79c228de2f04985e603114c553eeeff8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3e3fd000580843e101f7ceeb37fed04f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3894f98d61e24f23ed2d021718d4eb74.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea43d10>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_c6731109a5f588a84a6f9100e98c99c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c6731109a5f588a84a6f9100e98c99c8.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f78c490>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F33%252F4c33f53e52e032c58c7ed6ec241a3fc6%252Fpa%252FYD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b81aad7f-8e28-569e-b293-8a98f3cb0996
2026-03-28 10:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b81aad7f-8e28-569e-b293-8a98f3cb0996, skipping ID generation
2026-03-28 10:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 1
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b81aad7f-8e28-569e-b293-8a98f3cb0996 sending to next pipeline
2026-03-28 10:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b81aad7f-8e28-569e-b293-8a98f3cb0996, identifier: YD36788
2026-03-28 10:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-28 10:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-28 10:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788 to the API
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:36:06Z',
 'fuel_type': 'petrol',
 'id': 'b81aad7f-8e28-569e-b293-8a98f3cb0996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD36788',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 185392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_035e5b858c7aa76f04321b6a51f2ac74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_fc521578d3e5666c1ced4af32da71dfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_4767b47f297c74e710aedb3d0b9d7d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_8c1e55e3b749be3bbdf5922b28e690b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81aad7f-8e28-569e-b293-8a98f3cb0996/b81aad7f-8e28-569e-b293-8a98f3cb0996_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/33/4c33f53e52e032c58c7ed6ec241a3fc6/pa/YD36788_84f2003a8307d44921c9af017bceff2e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2006}
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-28 10:34:25 [auto1.de] INFO: Saving data for YD36788: {'created_time': 1774694065.856895, 'last_price_update_time': 1774694065.856905, 'auction_closing_time': 1774884966.0}
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD36788') HTTP/1.1" 204 0
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_da814af000f20a11e679095d4029572e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_6988431f741b894226080810817cc8f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_28919b98b9205b08093015668ca160a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea21bd0>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_79c228de2f04985e603114c553eeeff8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_79c228de2f04985e603114c553eeeff8.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6ba5d0>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_3e3fd000580843e101f7ceeb37fed04f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3e3fd000580843e101f7ceeb37fed04f.jpg saved to cache
2026-03-28 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca5a90>
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7c8b10>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_3894f98d61e24f23ed2d021718d4eb74.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3894f98d61e24f23ed2d021718d4eb74.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_41149eec7756495c7240cb9f6b13ba7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_8ee3d506956cc2445b90a850d2a85eda.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca7c90>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_da814af000f20a11e679095d4029572e.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_da814af000f20a11e679095d4029572e.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea57250>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_6988431f741b894226080810817cc8f8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_6988431f741b894226080810817cc8f8.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6b7590>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fae%252F83ae5b8d8709f9b379c0c2f7fbb08f5b%252Fpa%252FBM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12
2026-03-28 10:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12, skipping ID generation
2026-03-28 10:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 1
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 sending to next pipeline
2026-03-28 10:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12, identifier: BM85402
2026-03-28 10:34:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6bae10>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_28919b98b9205b08093015668ca160a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_28919b98b9205b08093015668ca160a4.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea56690>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-28 10:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-28 10:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402 to the API
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:56:00Z',
 'fuel_type': 'petrol',
 'id': 'e824cdae-8ff0-5fd8-a2bc-9589ffa65c12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM85402',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 107368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_9263b89f006fa3c3ae39858532f2ffdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_7d7e2b6f4a3ff74afb29213a650f6b9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_22b6f15cb1e42939bd5eb2f96f4b08e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_8a36f35a820c04a0bedf67d247b85b04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e824cdae-8ff0-5fd8-a2bc-9589ffa65c12/e824cdae-8ff0-5fd8-a2bc-9589ffa65c12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ae/83ae5b8d8709f9b379c0c2f7fbb08f5b/pa/BM85402_79c228de2f04985e603114c553eeeff8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2009}
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-28 10:34:26 [auto1.de] INFO: Saving data for BM85402: {'created_time': 1774694066.919696, 'last_price_update_time': 1774694066.919706, 'auction_closing_time': 1774886160.0}
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM85402') HTTP/1.1" 204 0
2026-03-28 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_4cdf5143260644c05d184931bb6cc81f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_c2f8240efc74dba13848fc190d63ab8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_755bb10186a449c06dc439f67c0d36c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd54536110>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_41149eec7756495c7240cb9f6b13ba7f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_41149eec7756495c7240cb9f6b13ba7f.jpg saved to cache
2026-03-28 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2cd90>
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_8ee3d506956cc2445b90a850d2a85eda.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_8ee3d506956cc2445b90a850d2a85eda.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_98c266be406d002913506b7d33a31e25.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_457544f87e5ae1e542364d754e0f34f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_6394d55552fa58af63d8b2b5818c3bef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec24b10>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_4cdf5143260644c05d184931bb6cc81f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_4cdf5143260644c05d184931bb6cc81f.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_ea40085b3212fa0a4a4378288acab0a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb7950>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_c2f8240efc74dba13848fc190d63ab8a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_c2f8240efc74dba13848fc190d63ab8a.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec3c210>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_755bb10186a449c06dc439f67c0d36c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_755bb10186a449c06dc439f67c0d36c8.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_f30125c17b48f708946a7baf031c4008.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_e8b72024d771324178be9651fc194d44.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_4a2bf035d4d36e18c993d1319da99caa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec05590>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_98c266be406d002913506b7d33a31e25.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_98c266be406d002913506b7d33a31e25.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f77d050>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_457544f87e5ae1e542364d754e0f34f4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_457544f87e5ae1e542364d754e0f34f4.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb4fa10>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_6394d55552fa58af63d8b2b5818c3bef.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_6394d55552fa58af63d8b2b5818c3bef.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_3339605282f2fc5d8e6c25c79a491d75.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb02b50>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_ea40085b3212fa0a4a4378288acab0a9.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_ea40085b3212fa0a4a4378288acab0a9.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f58cc10>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F09%252Fe909fecd29f3b07b6edc725f394d2262%252Fpa%252FCV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1997982-b8ac-5f76-816e-ddc917d75208
2026-03-28 10:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1997982-b8ac-5f76-816e-ddc917d75208, skipping ID generation
2026-03-28 10:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 1
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1997982-b8ac-5f76-816e-ddc917d75208 sending to next pipeline
2026-03-28 10:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1997982-b8ac-5f76-816e-ddc917d75208, identifier: CV20886
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaaa610>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_f30125c17b48f708946a7baf031c4008.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_f30125c17b48f708946a7baf031c4008.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eccd850>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Ff5%252F1df58e516fa1f70eee255ce2c57b0896%252Fpa%252FAD09354_e8b72024d771324178be9651fc194d44.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_e8b72024d771324178be9651fc194d44.jpg saved to cache
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5
2026-03-28 10:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15a9a5af-84fd-5697-90e4-bbb7b99220a5, skipping ID generation
2026-03-28 10:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 1
2026-03-28 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 sending to next pipeline
2026-03-28 10:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15a9a5af-84fd-5697-90e4-bbb7b99220a5, identifier: AD09354
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55910150>
2026-03-28 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ffa%252Fa8fabe8bb53ea51d73f9e82b715defef%252Fpa%252FNK14391_4a2bf035d4d36e18c993d1319da99caa.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_4a2bf035d4d36e18c993d1319da99caa.jpg saved to cache
2026-03-28 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb38948e-5a13-5b35-b748-8ede486b53b7
2026-03-28 10:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb38948e-5a13-5b35-b748-8ede486b53b7, skipping ID generation
2026-03-28 10:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 1
2026-03-28 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb38948e-5a13-5b35-b748-8ede486b53b7 sending to next pipeline
2026-03-28 10:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb38948e-5a13-5b35-b748-8ede486b53b7, identifier: NK14391
2026-03-28 10:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-28 10:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-28 10:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886 to the API
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:51:56Z',
 'fuel_type': 'diesel',
 'id': 'b1997982-b8ac-5f76-816e-ddc917d75208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV20886',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 136386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_2ab7a195e0bfa4971fb8bf5c4bb0098e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_8ee3d506956cc2445b90a850d2a85eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c485efa74ddeb75d091b7d8b41f660ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3894f98d61e24f23ed2d021718d4eb74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_3bd60d2406be58b91b5b5813fda92f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_6394d55552fa58af63d8b2b5818c3bef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_c6731109a5f588a84a6f9100e98c99c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_1cee1cb62d1e4e8d971057d29b815d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_11ab0af3fa215e7908d998fa8a1e0567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1997982-b8ac-5f76-816e-ddc917d75208/b1997982-b8ac-5f76-816e-ddc917d75208_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/09/e909fecd29f3b07b6edc725f394d2262/pa/CV20886_24e5f8bb5a113045e0aeb9ed764982f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2013}
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-28 10:34:28 [auto1.de] INFO: Saving data for CV20886: {'created_time': 1774694068.528611, 'last_price_update_time': 1774694068.528623, 'auction_closing_time': 1774885916.0}
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV20886') HTTP/1.1" 204 0
2026-03-28 10:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-28 10:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-28 10:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354 to the API
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_e8b72024d771324178be9651fc194d44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'diesel',
 'id': '15a9a5af-84fd-5697-90e4-bbb7b99220a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD09354',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 138977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696486,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_e8b72024d771324178be9651fc194d44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_2a6d5633e80b2a34c6a618382b7fc532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_da814af000f20a11e679095d4029572e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_366919bf540e3da1f07d2fa5d372fa3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3e3fd000580843e101f7ceeb37fed04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_28919b98b9205b08093015668ca160a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536219,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_457544f87e5ae1e542364d754e0f34f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_3debd2448105ba123977bf0db48fc722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_5beceb002bbf56b87e854fb8ea6cebfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a9a5af-84fd-5697-90e4-bbb7b99220a5/15a9a5af-84fd-5697-90e4-bbb7b99220a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/f5/1df58e516fa1f70eee255ce2c57b0896/pa/AD09354_98c266be406d002913506b7d33a31e25.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-28 10:34:28 [auto1.de] INFO: Saving data for AD09354: {'created_time': 1774694068.941724, 'last_price_update_time': 1774694068.941737, 'auction_closing_time': 1774883875.0}
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD09354') HTTP/1.1" 204 0
2026-03-28 10:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-28 10:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-28 10:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391 to the API
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_4a2bf035d4d36e18c993d1319da99caa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:51Z',
 'fuel_type': 'petrol',
 'id': 'bb38948e-5a13-5b35-b748-8ede486b53b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK14391',
 'listing': 'auction',
 'location': 'DE, Geldern',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 182979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_4a2bf035d4d36e18c993d1319da99caa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_f30125c17b48f708946a7baf031c4008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_db2fa5c92ef7390e3791a430feaf9ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_ed8be9c617efd34cbd84b9fd1e849c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb38948e-5a13-5b35-b748-8ede486b53b7/bb38948e-5a13-5b35-b748-8ede486b53b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/fa/a8fabe8bb53ea51d73f9e82b715defef/pa/NK14391_2af6af6ac7dfbef64d8fb885a75430ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-28 10:34:29 [auto1.de] INFO: Saving data for NK14391: {'created_time': 1774694069.355559, 'last_price_update_time': 1774694069.355572, 'auction_closing_time': 1774883871.0}
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK14391') HTTP/1.1" 204 0
2026-03-28 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF23902> (referer: https://www.auto1.com/v1/car-details-view/NF23902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf4a90>
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F22%252Fea2298859dc3728b4f90a630dbde0df2%252Fpa%252FHA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg saved to cache
2026-03-28 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3
2026-03-28 10:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3, skipping ID generation
2026-03-28 10:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 1
2026-03-28 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 sending to next pipeline
2026-03-28 10:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3, identifier: HA88960
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb14ad0>
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_3339605282f2fc5d8e6c25c79a491d75.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_3339605282f2fc5d8e6c25c79a491d75.jpg saved to cache
2026-03-28 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-28 10:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-28 10:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960 to the API
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:19:37Z',
 'fuel_type': 'petrol',
 'id': '3e727d63-6f2d-5957-8f00-a46b2fe5e7e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88960',
 'listing': 'auction',
 'location': 'DE, Passau',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 237990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_ea40085b3212fa0a4a4378288acab0a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_b45f4ddacad6b6ee1a60fac0a1c847e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_755bb10186a449c06dc439f67c0d36c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_0c1e8ac210d7588b34e9219156f3f86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_d7d516ac467a33c505f3f07366d15d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e727d63-6f2d-5957-8f00-a46b2fe5e7e3/3e727d63-6f2d-5957-8f00-a46b2fe5e7e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/22/ea2298859dc3728b4f90a630dbde0df2/pa/HA88960_6988431f741b894226080810817cc8f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-28 10:34:29 [auto1.de] INFO: Saving data for HA88960: {'created_time': 1774694069.983274, 'last_price_update_time': 1774694069.983286, 'auction_closing_time': 1774883977.0}
2026-03-28 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA88960') HTTP/1.1" 204 0
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea65990>
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg saved to cache
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-28 10:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169ad459-f862-5e89-b5db-ec445315b82c with scrape type 1
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 169ad459-f862-5e89-b5db-ec445315b82c
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_672e7cedf779e0b2b9aad52a76588b8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_672e7cedf779e0b2b9aad52a76588b8b.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_6af74c707dac14329dd6f9182f1cecd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_6af74c707dac14329dd6f9182f1cecd1.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_915c5ee7b1e6abacff0f97c2a4560866.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_915c5ee7b1e6abacff0f97c2a4560866.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_baca196b77f97b46e5cc8067ef9a0bd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_baca196b77f97b46e5cc8067ef9a0bd9.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_4ffe2c23b85aba202d603f9e91b6977b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_4ffe2c23b85aba202d603f9e91b6977b.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_67cec858f7b7842dfc58801fe9c932cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_67cec858f7b7842dfc58801fe9c932cc.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_20ea4b6edd7118bf80450fce7b32eebf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_20ea4b6edd7118bf80450fce7b32eebf.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_53fd12485fdb3694c38f92b3b539559c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_53fd12485fdb3694c38f92b3b539559c.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_d4da53406357f913edc1ae08d53ae7f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_d4da53406357f913edc1ae08d53ae7f4.jpg already downloaded
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F46%252F3f466a72f7b74416db623d9463198e5a%252Fpa%252FNF23902_785ad041f9a910759907ead4a28d20a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_785ad041f9a910759907ead4a28d20a9.jpg already downloaded
2026-03-28 10:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169ad459-f862-5e89-b5db-ec445315b82c, identifier: NF23902
2026-03-28 10:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-28 10:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-28 10:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902 to the API
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF23902>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': '169ad459-f862-5e89-b5db-ec445315b82c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23902',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 109457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_672e7cedf779e0b2b9aad52a76588b8b.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_6af74c707dac14329dd6f9182f1cecd1.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_915c5ee7b1e6abacff0f97c2a4560866.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_baca196b77f97b46e5cc8067ef9a0bd9.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_4ffe2c23b85aba202d603f9e91b6977b.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_67cec858f7b7842dfc58801fe9c932cc.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_20ea4b6edd7118bf80450fce7b32eebf.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_53fd12485fdb3694c38f92b3b539559c.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_d4da53406357f913edc1ae08d53ae7f4.jpg',
                'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_785ad041f9a910759907ead4a28d20a9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_672e7cedf779e0b2b9aad52a76588b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_6af74c707dac14329dd6f9182f1cecd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_915c5ee7b1e6abacff0f97c2a4560866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_baca196b77f97b46e5cc8067ef9a0bd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_4ffe2c23b85aba202d603f9e91b6977b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_67cec858f7b7842dfc58801fe9c932cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_20ea4b6edd7118bf80450fce7b32eebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_53fd12485fdb3694c38f92b3b539559c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_d4da53406357f913edc1ae08d53ae7f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169ad459-f862-5e89-b5db-ec445315b82c/169ad459-f862-5e89-b5db-ec445315b82c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/46/3f466a72f7b74416db623d9463198e5a/pa/NF23902_785ad041f9a910759907ead4a28d20a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-09-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-28 10:34:30 [auto1.de] INFO: Saving data for NF23902: {'created_time': 1774694070.677332, 'last_price_update_time': 1774694070.677342, 'auction_closing_time': 1774882992.0}
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF23902') HTTP/1.1" 204 0
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c89a49e76a92c154bc128aaf2c746d96.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_3f51df2a51914620246740c6943e5cb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_f06aa17fc3190d3e5de5d20892fea293.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd565acfd0>
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg saved to cache
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_67edd973bd6a1c8e804377aa5df015b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf4190>
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg saved to cache
2026-03-28 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55913650>
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_db178a0d23c277d462f0b94ba24444a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1b9d0>
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_c89a49e76a92c154bc128aaf2c746d96.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c89a49e76a92c154bc128aaf2c746d96.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f77df90>
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f5a98d2f5eaad6f0723b2f0ad527c6%252Fpa%252FEY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03eda04a-a574-5803-a3df-93d480f8bd52
2026-03-28 10:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03eda04a-a574-5803-a3df-93d480f8bd52, skipping ID generation
2026-03-28 10:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 1
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03eda04a-a574-5803-a3df-93d480f8bd52 sending to next pipeline
2026-03-28 10:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03eda04a-a574-5803-a3df-93d480f8bd52, identifier: EY64053
2026-03-28 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecd74d0>
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe0%252F13e0c60a7f88d67fc70d35e69785f9c8%252Fpa%252FYH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121
2026-03-28 10:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121, skipping ID generation
2026-03-28 10:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 1
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 sending to next pipeline
2026-03-28 10:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121, identifier: YH86831
2026-03-28 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6b6610>
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_3f51df2a51914620246740c6943e5cb7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_3f51df2a51914620246740c6943e5cb7.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd570aac90>
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F44%252Fb1444dd28549f53c61dc1c5ee39f3c6e%252Fpa%252FBF20079_f06aa17fc3190d3e5de5d20892fea293.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_f06aa17fc3190d3e5de5d20892fea293.jpg saved to cache
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9
2026-03-28 10:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b754d76a-4fe3-54a0-b42a-64d9c1b640f9, skipping ID generation
2026-03-28 10:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 1
2026-03-28 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 sending to next pipeline
2026-03-28 10:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b754d76a-4fe3-54a0-b42a-64d9c1b640f9, identifier: BF20079
2026-03-28 10:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-28 10:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-28 10:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053 to the API
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:44Z',
 'fuel_type': 'petrol',
 'id': '03eda04a-a574-5803-a3df-93d480f8bd52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY64053',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 42316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_af894bd6e990565fb13435d1755b1b2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_a1adf70002ae4ffbaa1090062ea34213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_f17756c79813ba2166827be1f0881486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_dd449f6aab28601ce5e4fcdfec5603ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_fdd45ce9ffe5daa454ad42c9bcf2c81d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_3339605282f2fc5d8e6c25c79a491d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_9709f4f1949fafd879f0e5ca65905253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_c2f8240efc74dba13848fc190d63ab8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_4cdf5143260644c05d184931bb6cc81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03eda04a-a574-5803-a3df-93d480f8bd52/03eda04a-a574-5803-a3df-93d480f8bd52_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44851,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f5a98d2f5eaad6f0723b2f0ad527c6/pa/EY64053_41149eec7756495c7240cb9f6b13ba7f.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Edition Sport40',
 'transmission': 'automatic',
 'trim': 'Edition Sport40',
 'year': 2021}
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-28 10:34:32 [auto1.de] INFO: Saving data for EY64053: {'created_time': 1774694072.32255, 'last_price_update_time': 1774694072.322561, 'auction_closing_time': 1774882964.0}
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY64053') HTTP/1.1" 204 0
2026-03-28 10:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-28 10:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-28 10:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831 to the API
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:12Z',
 'fuel_type': 'diesel',
 'id': '731a2dbc-6a6f-54bb-86fd-416c2bbb9121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86831',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 177977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_e2563560f2ee4ae7330a5530a15e45e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_aa81c973a45de197d23e2c2416c71967.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_547da11f98537c25215fbd1f7b4d0055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2190509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c89a49e76a92c154bc128aaf2c746d96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0ab8bf7f300d19c5aaf0e2392a059c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_a7fd7dc38f386c69476b90833835f4ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_8e11736266e65bc39eae2a8ccaaaaa58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_0496ea876b071009823bc16c0d075bbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_c968e4795ffb78827235b81863080b21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731a2dbc-6a6f-54bb-86fd-416c2bbb9121/731a2dbc-6a6f-54bb-86fd-416c2bbb9121_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e0/13e0c60a7f88d67fc70d35e69785f9c8/pa/YH86831_88e5627d1e9450401fba4344077f5011.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-28 10:34:32 [auto1.de] INFO: Saving data for YH86831: {'created_time': 1774694072.797569, 'last_price_update_time': 1774694072.797582, 'auction_closing_time': 1774885632.0}
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH86831') HTTP/1.1" 204 0
2026-03-28 10:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-28 10:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-28 10:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079 to the API
2026-03-28 10:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_f06aa17fc3190d3e5de5d20892fea293.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:51:44Z',
 'fuel_type': 'petrol',
 'id': 'b754d76a-4fe3-54a0-b42a-64d9c1b640f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF20079',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_9aca49f1b1c0a4ec0aa4c69847c766c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_229ed88017e93f15a38ddb9c3658aec1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_f06aa17fc3190d3e5de5d20892fea293.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_90affb3617511ff601f42877a64440f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2957259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_3f51df2a51914620246740c6943e5cb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_778d6d7b0e3e6205ed5a21a8ba126f7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_37d48101c5cac4e6eed15a32872b8a63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_dc26022745e826fed7df5448249f0858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_1b707c2a164ea11da4010a855ccfc562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754d76a-4fe3-54a0-b42a-64d9c1b640f9/b754d76a-4fe3-54a0-b42a-64d9c1b640f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/44/b1444dd28549f53c61dc1c5ee39f3c6e/pa/BF20079_36b55cd50e96050d4a6f76d28798ccec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion',
 'year': 2018}
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-28 10:34:33 [auto1.de] INFO: Saving data for BF20079: {'created_time': 1774694073.224824, 'last_price_update_time': 1774694073.224837, 'auction_closing_time': 1774885904.0}
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF20079') HTTP/1.1" 204 0
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb59cd0>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_67edd973bd6a1c8e804377aa5df015b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_67edd973bd6a1c8e804377aa5df015b6.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb58410>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f614a10>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_db178a0d23c277d462f0b94ba24444a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_db178a0d23c277d462f0b94ba24444a5.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5734d0>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_d59715daf63323028178c56b1b7d0452.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_012a04934610a83cb21229c4bfd1bb58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_893f348274e4acc0bec4e44390274a15.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_57e85b16a50c0dee4495312c49036fd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_c26c0e20c7db1ee987304a1860777f92.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea7be50>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_d59715daf63323028178c56b1b7d0452.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_d59715daf63323028178c56b1b7d0452.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec4a590>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_012a04934610a83cb21229c4bfd1bb58.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_012a04934610a83cb21229c4bfd1bb58.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf7bd0>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb84050>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_893f348274e4acc0bec4e44390274a15.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_893f348274e4acc0bec4e44390274a15.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea65b10>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg saved to cache
2026-03-28 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6c8850>
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_57e85b16a50c0dee4495312c49036fd5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_57e85b16a50c0dee4495312c49036fd5.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb857d0>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F25%252Fbc25dffbec7fcbbaccd8abd7e416ce13%252Fpa%252FZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8865f45d-a5c2-53d1-8c08-6e10660285cd
2026-03-28 10:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8865f45d-a5c2-53d1-8c08-6e10660285cd, skipping ID generation
2026-03-28 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 1
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8865f45d-a5c2-53d1-8c08-6e10660285cd sending to next pipeline
2026-03-28 10:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8865f45d-a5c2-53d1-8c08-6e10660285cd, identifier: ZY39038
2026-03-28 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-28 10:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-28 10:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038 to the API
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:40:13Z',
 'fuel_type': 'petrol',
 'id': '8865f45d-a5c2-53d1-8c08-6e10660285cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY39038',
 'listing': 'auction',
 'location': 'DE, Bad Neuenahr-Ahrweiler',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 109135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879679,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_893f348274e4acc0bec4e44390274a15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973603,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_069457dfd7fcf88a1f315236713e9ad1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_cae68e0468c45ca0e658b974c2e1dd7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_57e85b16a50c0dee4495312c49036fd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_9839e9e46b8aefe4cb594d167ca85680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_e1116ba6af55c56e93b4ddcf576f2652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ae71332cea2e8f167a17f5ea5276f4e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_db178a0d23c277d462f0b94ba24444a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_ca114fd056d5ebe5a9ddfd3e51bbe941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8865f45d-a5c2-53d1-8c08-6e10660285cd/8865f45d-a5c2-53d1-8c08-6e10660285cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/25/bc25dffbec7fcbbaccd8abd7e416ce13/pa/ZY39038_5f75775f952a54b43d1dd3a9218527b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-28 10:34:34 [auto1.de] INFO: Saving data for ZY39038: {'created_time': 1774694074.681259, 'last_price_update_time': 1774694074.681269, 'auction_closing_time': 1774885213.0}
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY39038') HTTP/1.1" 204 0
2026-03-28 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb8e990>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_9860606cfc06938d427f6769eedc173d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55e34f90>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_c26c0e20c7db1ee987304a1860777f92.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_c26c0e20c7db1ee987304a1860777f92.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6358d0>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f634950>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e2f10>
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4d%252Fbb4d271e21465bc23df92e6b81a58989%252Fpa%252FBF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg saved to cache
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c4af197-bd73-5e48-b752-38c65235f529
2026-03-28 10:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c4af197-bd73-5e48-b752-38c65235f529, skipping ID generation
2026-03-28 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 1
2026-03-28 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c4af197-bd73-5e48-b752-38c65235f529 sending to next pipeline
2026-03-28 10:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4af197-bd73-5e48-b752-38c65235f529, identifier: BF10429
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb4f8d0>
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_9860606cfc06938d427f6769eedc173d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_9860606cfc06938d427f6769eedc173d.jpg saved to cache
2026-03-28 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-28 10:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-28 10:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429 to the API
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:16Z',
 'fuel_type': 'petrol',
 'id': '5c4af197-bd73-5e48-b752-38c65235f529',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF10429',
 'listing': 'auction',
 'location': 'DE, Dormagen',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 203115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_c26c0e20c7db1ee987304a1860777f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_641ba77fbe486fa40fd3d82875ec63cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_dafd028e4089489aa2fb77d8caa2b2c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_f5fc347eab5d1d71792db6b7c3fceb47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_46e3d06261d36b83c250ba9ffcd81be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_d59715daf63323028178c56b1b7d0452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_012a04934610a83cb21229c4bfd1bb58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_48b5de38a4b89de7a80bb86ec7cb93e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_67edd973bd6a1c8e804377aa5df015b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c4af197-bd73-5e48-b752-38c65235f529/5c4af197-bd73-5e48-b752-38c65235f529_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4d/bb4d271e21465bc23df92e6b81a58989/pa/BF10429_8b635c0b41f7b1bcea5a86bb413110a5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2018}
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-28 10:34:35 [auto1.de] INFO: Saving data for BF10429: {'created_time': 1774694075.495649, 'last_price_update_time': 1774694075.49566, 'auction_closing_time': 1774883716.0}
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF10429') HTTP/1.1" 204 0
2026-03-28 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_218800fac86f166e3e85e3a2868625b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f65cd10>
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F30%252F1230163a643b27e5dc95eeae22f34913%252Fpa%252FDA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg saved to cache
2026-03-28 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32d3a715-6266-5382-bf96-20a3a23861e4
2026-03-28 10:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32d3a715-6266-5382-bf96-20a3a23861e4, skipping ID generation
2026-03-28 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 1
2026-03-28 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32d3a715-6266-5382-bf96-20a3a23861e4 sending to next pipeline
2026-03-28 10:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d3a715-6266-5382-bf96-20a3a23861e4, identifier: DA22909
2026-03-28 10:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-28 10:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-28 10:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909 to the API
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:31Z',
 'fuel_type': 'petrol',
 'id': '32d3a715-6266-5382-bf96-20a3a23861e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA22909',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 132266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_6fdc3362b5e223fed9e9346ff1183cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_9860606cfc06938d427f6769eedc173d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_96ba80a0541212321a2f1d042172603a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_cbd12786fc0d2cdcfeb6fe828174e2f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_7010f8bc8b316ff26e650ea9f078928a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_8aec290c5ad42b59574c8b757d29f835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_d38f26cd333a193fe62fb0873e3c3fb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_edf9e6fdb18b9505fe788fbaffe546ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_eb1868bb7140475d306a50a8bfa56eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32d3a715-6266-5382-bf96-20a3a23861e4/32d3a715-6266-5382-bf96-20a3a23861e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2949041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/30/1230163a643b27e5dc95eeae22f34913/pa/DA22909_04d0383b79e73ccf917da131b302daa0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-28 10:34:36 [auto1.de] INFO: Saving data for DA22909: {'created_time': 1774694076.109429, 'last_price_update_time': 1774694076.109442, 'auction_closing_time': 1774883551.0}
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA22909') HTTP/1.1" 204 0
2026-03-28 10:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6c2bd0>
2026-03-28 10:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F42%252Fd54245c2857eb031a2821bdb5f080449%252Fpa%252FXY13632_218800fac86f166e3e85e3a2868625b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_218800fac86f166e3e85e3a2868625b3.jpg saved to cache
2026-03-28 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d71bd56-9b91-5743-99d5-0d6926000427
2026-03-28 10:34:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d71bd56-9b91-5743-99d5-0d6926000427, skipping ID generation
2026-03-28 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 1
2026-03-28 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d71bd56-9b91-5743-99d5-0d6926000427 sending to next pipeline
2026-03-28 10:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d71bd56-9b91-5743-99d5-0d6926000427, identifier: XY13632
2026-03-28 10:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-28 10:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-28 10:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632 to the API
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_218800fac86f166e3e85e3a2868625b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:06:44Z',
 'fuel_type': 'petrol',
 'id': '6d71bd56-9b91-5743-99d5-0d6926000427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY13632',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_218800fac86f166e3e85e3a2868625b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d8e4c7342e36a83edfc7891cdba8ff0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9ef207d7c17e5121195ff08e3f5249e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_d7e828714ee9144e2480c171412e55aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_77e27fb1af0059efe53985b399ceefeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d71bd56-9b91-5743-99d5-0d6926000427/6d71bd56-9b91-5743-99d5-0d6926000427_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/42/d54245c2857eb031a2821bdb5f080449/pa/XY13632_9311afa95351911115a33e2570d7355a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2009}
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-28 10:34:36 [auto1.de] INFO: Saving data for XY13632: {'created_time': 1774694076.721366, 'last_price_update_time': 1774694076.721379, 'auction_closing_time': 1774883204.0}
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY13632') HTTP/1.1" 204 0
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY17523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL20163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW03523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW53776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_60760401e685be49dd2bbb249dc5e8a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_bd2b3410546031f5ce801bacc6a671af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:36 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9620 | hits on page: 40
2026-03-28 10:34:36 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-28 10:34:36 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-28 10:34:36 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-28 10:34:36 [auto1.de] INFO: Scrape type for KR12848: 2
2026-03-28 10:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-28 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-28 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-28 10:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e66d2369-84ab-5547-82d1-4404b80b8f02, identifier: KR12848
2026-03-28 10:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-28 10:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-28 10:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848 to the API
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:06Z',
 'fuel_type': 'petrol',
 'id': 'e66d2369-84ab-5547-82d1-4404b80b8f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR12848',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 89270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-28 10:34:37 [auto1.de] INFO: Saving data for KR12848: {'auction_closing_time': 1774882926.0, 'created_time': 1773427823.4383, 'last_price_update_time': 1774694077.427012}
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR12848') HTTP/1.1" 204 0
2026-03-28 10:34:37 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-28 10:34:37 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-28 10:34:37 [auto1.de] INFO: Scrape type for UE39516: 1
2026-03-28 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM01256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR22131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD07606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:37 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-28 10:34:37 [auto1.de] INFO: Scrape type for RR83304: 1
2026-03-28 10:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f634350>
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg saved to cache
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf9b50>
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg saved to cache
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5c0bd0>
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_60760401e685be49dd2bbb249dc5e8a6.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_60760401e685be49dd2bbb249dc5e8a6.jpg saved to cache
2026-03-28 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6bcad0>
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg saved to cache
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecdc890>
2026-03-28 10:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fe5%252Fede54ba239dbfcaf23a3eac21e5e4ca2%252Fpa%252FUK87241_bd2b3410546031f5ce801bacc6a671af.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_bd2b3410546031f5ce801bacc6a671af.jpg saved to cache
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043
2026-03-28 10:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22b1e385-5bd9-5cf9-9f7a-77381ab83043, skipping ID generation
2026-03-28 10:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 1
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 sending to next pipeline
2026-03-28 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b1e385-5bd9-5cf9-9f7a-77381ab83043, identifier: UK87241
2026-03-28 10:34:38 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-28 10:34:38 [auto1.de] INFO: Scrape type for GM93366: 1
2026-03-28 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-28 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-28 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241 to the API
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_bd2b3410546031f5ce801bacc6a671af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:01:29Z',
 'fuel_type': 'petrol',
 'id': '22b1e385-5bd9-5cf9-9f7a-77381ab83043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK87241',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 136106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_5a9ef814238bd8aeb1f0931a5a86f338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3387426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_93bf611b5d2d1ea30031c54342b68b4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_4a1719aee699bc0aabf19fd522c9fe61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3220942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_8a60860e485ad1e2c3380ec689a8fbce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3517763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_bd2b3410546031f5ce801bacc6a671af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3299628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_60760401e685be49dd2bbb249dc5e8a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3197112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_b99383daf942e0949706ad9e01b2e668.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3172954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_eccbc7134a875cde1b0fc78e82842ee5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1470440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_3f382491f3e1c5e1f57fc14ec012cdb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b1e385-5bd9-5cf9-9f7a-77381ab83043/22b1e385-5bd9-5cf9-9f7a-77381ab83043_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/e5/ede54ba239dbfcaf23a3eac21e5e4ca2/pa/UK87241_9742a863b15a53b265101b2684cae03d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-28 10:34:38 [auto1.de] INFO: Saving data for UK87241: {'created_time': 1774694078.650329, 'last_price_update_time': 1774694078.65034, 'auction_closing_time': 1774882889.0}
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK87241') HTTP/1.1" 204 0
2026-03-28 10:34:38 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-28 10:34:38 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-28 10:34:38 [auto1.de] INFO: Scrape type for VV13794: 2
2026-03-28 10:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-28 10:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-28 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-28 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b, identifier: VV13794
2026-03-28 10:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-28 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-28 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794 to the API
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'diesel',
 'id': '2208c465-4e02-57a6-85a6-2a2d0f9f0d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV13794',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 41839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-28 10:34:39 [auto1.de] INFO: Saving data for VV13794: {'auction_closing_time': 1774883516.0, 'created_time': 1773302816.426452, 'last_price_update_time': 1774694079.113105}
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV13794') HTTP/1.1" 204 0
2026-03-28 10:34:39 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-28 10:34:39 [auto1.de] INFO: Scrape type for YZ93314: 2
2026-03-28 10:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-28 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-28 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-28 10:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d, identifier: YZ93314
2026-03-28 10:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-28 10:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-28 10:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314 to the API
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:37:35Z',
 'fuel_type': 'diesel',
 'id': '9d1dd039-1e61-50eb-a5cd-8c14f81b000d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ93314',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 126211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2016}
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-28 10:34:39 [auto1.de] INFO: Saving data for YZ93314: {'auction_closing_time': 1774885055.0, 'created_time': 1774349599.288837, 'last_price_update_time': 1774694079.571434}
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ93314') HTTP/1.1" 204 0
2026-03-28 10:34:39 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-28 10:34:39 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-28 10:34:39 [auto1.de] INFO: Scrape type for ZE64138: 2
2026-03-28 10:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-28 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-28 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-28 10:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8, identifier: ZE64138
2026-03-28 10:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-28 10:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-28 10:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138 to the API
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:18Z',
 'fuel_type': 'diesel',
 'id': 'ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE64138',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 167222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Saving data for ZE64138: {'auction_closing_time': 1774884498.0, 'created_time': 1773428711.309024, 'last_price_update_time': 1774694080.258472}
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE64138') HTTP/1.1" 204 0
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Scrape type for FH72870: 2
2026-03-28 10:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-28 10:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-28 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-28 10:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86906fa7-6293-511d-94fc-741a93ab8427, identifier: FH72870
2026-03-28 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV93942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD00982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-28 10:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-28 10:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870 to the API
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:39:30Z',
 'fuel_type': 'petrol',
 'id': '86906fa7-6293-511d-94fc-741a93ab8427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH72870',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 230943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-26',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Saving data for FH72870: {'auction_closing_time': 1774885170.0, 'created_time': 1774349732.154987, 'last_price_update_time': 1774694080.905561}
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH72870') HTTP/1.1" 204 0
2026-03-28 10:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF87196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Scrape type for RV36249: 1
2026-03-28 10:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Scrape type for GR32471: 1
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-28 10:34:40 [auto1.de] INFO: Scrape type for TJ69669: 1
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-28 10:34:40 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-28 10:34:41 [auto1.de] INFO: Scrape type for CX33153: 2
2026-03-28 10:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-28 10:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-28 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-28 10:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac2daf7a-7463-583c-b610-2b84de3ebca8, identifier: CX33153
2026-03-28 10:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-28 10:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-28 10:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153 to the API
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:02Z',
 'fuel_type': 'diesel',
 'id': 'ac2daf7a-7463-583c-b610-2b84de3ebca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX33153',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 205182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-28 10:34:41 [auto1.de] INFO: Saving data for CX33153: {'auction_closing_time': 1774884602.0, 'created_time': 1774032868.602166, 'last_price_update_time': 1774694081.457077}
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX33153') HTTP/1.1" 204 0
2026-03-28 10:34:41 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-28 10:34:41 [auto1.de] INFO: Scrape type for XL82798: 1
2026-03-28 10:34:41 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-28 10:34:41 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-28 10:34:41 [auto1.de] INFO: Scrape type for DE88009: 2
2026-03-28 10:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-28 10:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-28 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-28 10:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa, identifier: DE88009
2026-03-28 10:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-28 10:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-28 10:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009 to the API
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:42Z',
 'fuel_type': 'diesel',
 'id': 'd9be9d28-90d2-5cda-b5d8-7e02de97eaaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE88009',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 121387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Saving data for DE88009: {'auction_closing_time': 1774884102.0, 'created_time': 1774118823.170682, 'last_price_update_time': 1774694082.113601}
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE88009') HTTP/1.1" 204 0
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Scrape type for HF51839: 1
2026-03-28 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE39516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM93366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR83304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Scrape type for EC79074: 1
2026-03-28 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW03523> (referer: https://www.auto1.com/v1/car-details-view/RW03523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Scrape type for KE20907: 1
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Scrape type for ZM57049: 2
2026-03-28 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-28 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-28 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-28 10:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ac4764f-d828-590a-822d-84fb53c8f546, identifier: ZM57049
2026-03-28 10:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-28 10:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-28 10:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049 to the API
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:44Z',
 'fuel_type': 'petrol',
 'id': '7ac4764f-d828-590a-822d-84fb53c8f546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM57049',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 263804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Saving data for ZM57049: {'auction_closing_time': 1774884464.0, 'created_time': 1774002630.422864, 'last_price_update_time': 1774694082.715638}
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM57049') HTTP/1.1" 204 0
2026-03-28 10:34:42 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-28 10:34:42 [auto1.de] INFO: Scrape type for KW41122: 2
2026-03-28 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-28 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-28 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-28 10:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cede8d43-5a9e-5af2-9b7e-31bdee79550a, identifier: KW41122
2026-03-28 10:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-28 10:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-28 10:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122 to the API
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:26:06Z',
 'fuel_type': 'petrol',
 'id': 'cede8d43-5a9e-5af2-9b7e-31bdee79550a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41122',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 64442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2020}
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Saving data for KW41122: {'auction_closing_time': 1774884366.0, 'created_time': 1774349955.289039, 'last_price_update_time': 1774694083.285978}
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW41122') HTTP/1.1" 204 0
2026-03-28 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW53776> (referer: https://www.auto1.com/v1/car-details-view/GW53776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-28 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 1
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_edcffd823c6211d5e778df48c2ee99b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_edcffd823c6211d5e778df48c2ee99b7.jpg not downloaded yet
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Scrape type for EU16330: 1
2026-03-28 10:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_845b49f1a9471b01d956c53b29c848d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_845b49f1a9471b01d956c53b29c848d7.jpg not downloaded yet
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Scrape type for DR88922: 1
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_9b8c590269af8436b2c213de17d8269d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_9b8c590269af8436b2c213de17d8269d.jpg not downloaded yet
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Scrape type for SL55745: 2
2026-03-28 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-28 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-28 10:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53b9138-9074-555b-b88c-a70257f8f2c4, identifier: SL55745
2026-03-28 10:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-28 10:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-28 10:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745 to the API
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:42Z',
 'fuel_type': 'petrol',
 'id': 'a53b9138-9074-555b-b88c-a70257f8f2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL55745',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 127090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Saving data for SL55745: {'auction_closing_time': 1774885782.0, 'created_time': 1774380238.421618, 'last_price_update_time': 1774694083.82925}
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL55745') HTTP/1.1" 204 0
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg not downloaded yet
2026-03-28 10:34:43 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [auto1.de] INFO: Scrape type for WA61115: 1
2026-03-28 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_edcffd823c6211d5e778df48c2ee99b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg not downloaded yet
2026-03-28 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-28 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 1
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg not downloaded yet
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg not downloaded yet
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg not downloaded yet
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg not downloaded yet
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_750180302db05b94fb293ae497ecc692.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_750180302db05b94fb293ae497ecc692.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg not downloaded yet
2026-03-28 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL20163> (referer: https://www.auto1.com/v1/car-details-view/XL20163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg not downloaded yet
2026-03-28 10:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_25b227782fb7988858f6001eeec59993.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_25b227782fb7988858f6001eeec59993.jpg not downloaded yet
2026-03-28 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f66f290>
2026-03-28 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_edcffd823c6211d5e778df48c2ee99b7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_edcffd823c6211d5e778df48c2ee99b7.jpg saved to cache
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_56b109684ca00aede38e66696f153adb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_56b109684ca00aede38e66696f153adb.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_c157529e1d4196208335ee51b2d5d803.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_c157529e1d4196208335ee51b2d5d803.jpg not downloaded yet
2026-03-28 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg not downloaded yet
2026-03-28 10:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-28 10:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 1
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_a079b152ab07956fe2fc008f36026c71.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_a079b152ab07956fe2fc008f36026c71.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_ba0786cb2a733c0c538f6058f21dc159.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ba0786cb2a733c0c538f6058f21dc159.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_5dfe71e86860d73830fe67ba040a9e42.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_5dfe71e86860d73830fe67ba040a9e42.jpg not downloaded yet
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg not downloaded yet
2026-03-28 10:34:44 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9620 | hits on page: 40
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_73b12d92bbcc224629ddccf5119ba1be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_73b12d92bbcc224629ddccf5119ba1be.jpg not downloaded yet
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Scrape type for SJ49235: 1
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Scrape type for BT33018: 1
2026-03-28 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Scrape type for KT95165: 1
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Scrape type for JX65004: 2
2026-03-28 10:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-28 10:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-28 10:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7ed1071-c499-5702-b65b-3b299dc96b2d, identifier: JX65004
2026-03-28 10:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-28 10:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-28 10:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004 to the API
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'petrol',
 'id': 'f7ed1071-c499-5702-b65b-3b299dc96b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX65004',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 125671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 43 AMG 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2017}
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Saving data for JX65004: {'auction_closing_time': 1774883859.0, 'created_time': 1773427187.821561, 'last_price_update_time': 1774694084.851961}
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX65004') HTTP/1.1" 204 0
2026-03-28 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV36249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_56b109684ca00aede38e66696f153adb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:44 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-28 10:34:44 [auto1.de] INFO: Scrape type for VG77732: 2
2026-03-28 10:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-28 10:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-28 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-28 10:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12179171-19be-5438-b8bc-33c1509085bf, identifier: VG77732
2026-03-28 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-28 10:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-28 10:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732 to the API
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:53:01Z',
 'fuel_type': 'petrol',
 'id': '12179171-19be-5438-b8bc-33c1509085bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG77732',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 81203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2018}
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-28 10:34:45 [auto1.de] INFO: Saving data for VG77732: {'auction_closing_time': 1774885981.0, 'created_time': 1774031735.778555, 'last_price_update_time': 1774694085.435364}
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG77732') HTTP/1.1" 204 0
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb85c10>
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg saved to cache
2026-03-28 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:34:45 [auto1.de] INFO: Found listing with ID: PS20271
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS20271%27 HTTP/1.1" 200 None
2026-03-28 10:34:45 [auto1.de] INFO: Scrape type for PS20271: 1
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR22131> (referer: https://www.auto1.com/v1/car-details-view/HR22131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD07606> (referer: https://www.auto1.com/v1/car-details-view/UD07606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV93942> (referer: https://www.auto1.com/v1/car-details-view/JV93942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD00982> (referer: https://www.auto1.com/v1/car-details-view/DD00982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea72b90>
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_56b109684ca00aede38e66696f153adb.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_56b109684ca00aede38e66696f153adb.jpg saved to cache
2026-03-28 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:34:45 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-28 10:34:45 [auto1.de] INFO: Scrape type for MW16405: 2
2026-03-28 10:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-28 10:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-28 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-28 10:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6, identifier: MW16405
2026-03-28 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY17523> (referer: https://www.auto1.com/v1/car-details-view/ZY17523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM01256> (referer: https://www.auto1.com/v1/car-details-view/YM01256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-28 10:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-28 10:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405 to the API
2026-03-28 10:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'diesel',
 'id': '4eabf51d-c195-50eb-9294-2db4cf9f9fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16405',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 137367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [auto1.de] INFO: Saving data for MW16405: {'auction_closing_time': 1774884537.0, 'created_time': 1773468073.91769, 'last_price_update_time': 1774694086.172162}
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW16405') HTTP/1.1" 204 0
2026-03-28 10:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:46 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-28 10:34:46 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [auto1.de] INFO: Scrape type for BY24352: 1
2026-03-28 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_73b12d92bbcc224629ddccf5119ba1be.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:46 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [auto1.de] INFO: Scrape type for SV90594: 1
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_67f46bee3b1e518308233fa9fa3af796.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_67f46bee3b1e518308233fa9fa3af796.jpg not downloaded yet
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b7e8ae-d276-5575-917e-51d2cd665d74 with identifier: UD07606
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b7e8ae-d276-5575-917e-51d2cd665d74 with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_a888b0f247496eec3312bd7ac870790d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_a888b0f247496eec3312bd7ac870790d.jpg not downloaded yet
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_d414a4206007b91a36ef579456ba59ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_d414a4206007b91a36ef579456ba59ca.jpg not downloaded yet
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e6e885-b7f9-53e4-aa92-4466c522b74d with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6e6e885-b7f9-53e4-aa92-4466c522b74d
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_8f8eecca440b802c6abf2b0ea0ba2d9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_8f8eecca440b802c6abf2b0ea0ba2d9c.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_10d7743e9cd968eca913d386712384f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_10d7743e9cd968eca913d386712384f2.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_89825544fa0ee25563790dbc2da24731.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_89825544fa0ee25563790dbc2da24731.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_4af0535bbac3812f8f1502d4b3d9a879.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_4af0535bbac3812f8f1502d4b3d9a879.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_5954acbc0d3850b23fac9b00af4af268.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5954acbc0d3850b23fac9b00af4af268.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_e184e186ad86b63e3be24b9f4a426a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_e184e186ad86b63e3be24b9f4a426a3c.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_5ad570bf42ab27c1e151a4c91b7b8df7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5ad570bf42ab27c1e151a4c91b7b8df7.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_3f08c3a040590e5e64f7ba1fec42a98d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_3f08c3a040590e5e64f7ba1fec42a98d.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_6ecaa6381dc18522d11d2c2d712e1ea0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_6ecaa6381dc18522d11d2c2d712e1ea0.jpg already downloaded
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c1078d5c825a43b4ec10b19eef305%252Fpa%252FDD00982_054082b1332cf6ad00de6479f5507fc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_054082b1332cf6ad00de6479f5507fc9.jpg already downloaded
2026-03-28 10:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e6e885-b7f9-53e4-aa92-4466c522b74d, identifier: DD00982
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg not downloaded yet
2026-03-28 10:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-28 10:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 1
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg not downloaded yet
2026-03-28 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-28 10:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-28 10:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982 to the API
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DD00982>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'diesel',
 'id': 'c6e6e885-b7f9-53e4-aa92-4466c522b74d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD00982',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 166112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_8f8eecca440b802c6abf2b0ea0ba2d9c.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_10d7743e9cd968eca913d386712384f2.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_89825544fa0ee25563790dbc2da24731.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_4af0535bbac3812f8f1502d4b3d9a879.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5954acbc0d3850b23fac9b00af4af268.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_e184e186ad86b63e3be24b9f4a426a3c.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5ad570bf42ab27c1e151a4c91b7b8df7.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_3f08c3a040590e5e64f7ba1fec42a98d.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_6ecaa6381dc18522d11d2c2d712e1ea0.jpg',
                'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_054082b1332cf6ad00de6479f5507fc9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_8f8eecca440b802c6abf2b0ea0ba2d9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_10d7743e9cd968eca913d386712384f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_89825544fa0ee25563790dbc2da24731.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_4af0535bbac3812f8f1502d4b3d9a879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5954acbc0d3850b23fac9b00af4af268.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_e184e186ad86b63e3be24b9f4a426a3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_5ad570bf42ab27c1e151a4c91b7b8df7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_3f08c3a040590e5e64f7ba1fec42a98d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_6ecaa6381dc18522d11d2c2d712e1ea0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e6e885-b7f9-53e4-aa92-4466c522b74d/c6e6e885-b7f9-53e4-aa92-4466c522b74d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3081639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c1078d5c825a43b4ec10b19eef305/pa/DD00982_054082b1332cf6ad00de6479f5507fc9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [auto1.de] INFO: Saving data for DD00982: {'created_time': 1774694087.022759, 'last_price_update_time': 1774694087.02277, 'auction_closing_time': 1774884518.0}
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD00982') HTTP/1.1" 204 0
2026-03-28 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_5dfe71e86860d73830fe67ba040a9e42.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:47 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [auto1.de] INFO: Scrape type for CN43056: 1
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_0ba9b939d325e3830bac2dafd3001c53.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_0ba9b939d325e3830bac2dafd3001c53.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_440a280775c98260d37cf38d8c4b500b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_440a280775c98260d37cf38d8c4b500b.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_7c675df954c07071d26a4bb078a7850f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_7c675df954c07071d26a4bb078a7850f.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_58bbc42fc76d22c9c922290ae952325b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_58bbc42fc76d22c9c922290ae952325b.jpg not downloaded yet
2026-03-28 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR32471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:47 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [auto1.de] INFO: Scrape type for RA08562: 2
2026-03-28 10:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-28 10:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-28 10:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8efef272-f0e7-569f-a3f9-44308784166b, identifier: RA08562
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_41adf98570717b033254b84eae0a558c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_41adf98570717b033254b84eae0a558c.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg not downloaded yet
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg not downloaded yet
2026-03-28 10:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-28 10:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-28 10:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562 to the API
2026-03-28 10:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'petrol',
 'id': '8efef272-f0e7-569f-a3f9-44308784166b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA08562',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 128632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2017}
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [auto1.de] INFO: Saving data for RA08562: {'auction_closing_time': 1774883074.0, 'created_time': 1774031664.268552, 'last_price_update_time': 1774694088.279083}
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA08562') HTTP/1.1" 204 0
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb6310>
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_73b12d92bbcc224629ddccf5119ba1be.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_73b12d92bbcc224629ddccf5119ba1be.jpg saved to cache
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea32050>
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg saved to cache
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:34:48 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [auto1.de] INFO: Scrape type for EL77757: 1
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_4feede12169dbb606d797bccd53fb132.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_4feede12169dbb606d797bccd53fb132.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_5a3989aa90e0cc71366e87729c3e287d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_5a3989aa90e0cc71366e87729c3e287d.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_92181527449fef6a83ea092635089af6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_92181527449fef6a83ea092635089af6.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_d20a027201dabf00af68e91048ae48a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_d20a027201dabf00af68e91048ae48a5.jpg not downloaded yet
2026-03-28 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF51839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF87196> (referer: https://www.auto1.com/v1/car-details-view/ZF87196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL82798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC79074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:48 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [auto1.de] INFO: Scrape type for MZ03639: 2
2026-03-28 10:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-28 10:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-28 10:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afba7f48-3803-5520-a7ee-cb203868f1e3, identifier: MZ03639
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_82fab6ad88a7719e910d411efd56e0d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_82fab6ad88a7719e910d411efd56e0d9.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_bfdfe490710e160394857c399fc4ebd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_bfdfe490710e160394857c399fc4ebd7.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg not downloaded yet
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg not downloaded yet
2026-03-28 10:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ69669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f582fd0>
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_5dfe71e86860d73830fe67ba040a9e42.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_5dfe71e86860d73830fe67ba040a9e42.jpg saved to cache
2026-03-28 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-28 10:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-28 10:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639 to the API
2026-03-28 10:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:51:35Z',
 'fuel_type': 'diesel',
 'id': 'afba7f48-3803-5520-a7ee-cb203868f1e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ03639',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 224587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-17',
 'seller_name': None,
 'title': 'Volvo XC60 2.4D DRIVe Summum Drive',
 'transmission': 'automatic',
 'trim': 'Summum Drive',
 'year': 2010}
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [auto1.de] INFO: Saving data for MZ03639: {'auction_closing_time': 1774885895.0, 'created_time': 1774348962.067369, 'last_price_update_time': 1774694089.220893}
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ03639') HTTP/1.1" 204 0
2026-03-28 10:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:49 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [auto1.de] INFO: Scrape type for BS45971: 2
2026-03-28 10:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-28 10:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-28 10:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc, identifier: BS45971
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg not downloaded yet
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_16493acb4ab63a712c818a9f0338eff8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_16493acb4ab63a712c818a9f0338eff8.jpg not downloaded yet
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg not downloaded yet
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_9722f211795dbffb51925b6b42c40a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9722f211795dbffb51925b6b42c40a41.jpg not downloaded yet
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_a58b64293247d5343044f317efe6e7f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a58b64293247d5343044f317efe6e7f1.jpg not downloaded yet
2026-03-28 10:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_58bbc42fc76d22c9c922290ae952325b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-28 10:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-28 10:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971 to the API
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:41:59Z',
 'fuel_type': 'hybrid',
 'id': '6bf41aa3-5862-5b23-9dfa-3008f24b7ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS45971',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 48512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Plug-in Hybrid Spirit",
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [auto1.de] INFO: Saving data for BS45971: {'auction_closing_time': 1774885319.0, 'created_time': 1774118561.163237, 'last_price_update_time': 1774694089.825369}
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS45971') HTTP/1.1" 204 0
2026-03-28 10:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-28 10:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 1
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg not downloaded yet
2026-03-28 10:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:49 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-28 10:34:49 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for NT95392: 1
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_abff4d0d94f04d585b017268e8baf405.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_abff4d0d94f04d585b017268e8baf405.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_76c564712b5313c36abb63896ded8ea4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_76c564712b5313c36abb63896ded8ea4.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_f720b635e4336094ce560c531475e70e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f720b635e4336094ce560c531475e70e.jpg not downloaded yet
2026-03-28 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA61115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_d20a027201dabf00af68e91048ae48a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg not downloaded yet
2026-03-28 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_4feede12169dbb606d797bccd53fb132.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for FB20065: 1
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_017725a0a044c703a27ea6ab54817b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_017725a0a044c703a27ea6ab54817b55.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_7c9f19034f319bfd21913ad4c145e438.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_7c9f19034f319bfd21913ad4c145e438.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_1994d84aec44343af256f4eb0155629a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_1994d84aec44343af256f4eb0155629a.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_b08b42ce294ea6cec86480e3c84e1319.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b08b42ce294ea6cec86480e3c84e1319.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_675bbd828983055ce14c8a58e13109e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_675bbd828983055ce14c8a58e13109e3.jpg not downloaded yet
2026-03-28 10:34:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaed050>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eae8b90>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_58bbc42fc76d22c9c922290ae952325b.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_58bbc42fc76d22c9c922290ae952325b.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for YV73995: 1
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_c82962e75d155073f3954845c43c4643.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_c82962e75d155073f3954845c43c4643.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_4a232869e972efa2eeae4639f6463282.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4a232869e972efa2eeae4639f6463282.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_9bbffb59506ac8677b4006eab1b78888.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_9bbffb59506ac8677b4006eab1b78888.jpg not downloaded yet
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ead26d0>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea5af10>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_d20a027201dabf00af68e91048ae48a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_d20a027201dabf00af68e91048ae48a5.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a58b64293247d5343044f317efe6e7f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for JX55294: 1
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_4b77a43e4bd2fba92ea622b104dce399.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4b77a43e4bd2fba92ea622b104dce399.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg not downloaded yet
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_62557428d427bdd57aabaced82ff037f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_62557428d427bdd57aabaced82ff037f.jpg not downloaded yet
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d3990>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_4feede12169dbb606d797bccd53fb132.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_4feede12169dbb606d797bccd53fb132.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg not downloaded yet
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for BK93979: 1
2026-03-28 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg not downloaded yet
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea10b50>
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_a58b64293247d5343044f317efe6e7f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a58b64293247d5343044f317efe6e7f1.jpg saved to cache
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-28 10:34:50 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-28 10:34:50 [auto1.de] INFO: Scrape type for LC65511: 2
2026-03-28 10:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-28 10:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-28 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-28 10:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a, identifier: LC65511
2026-03-28 10:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-28 10:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-28 10:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511 to the API
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'petrol',
 'id': 'd5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC65511',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Murano',
 'odometer': 164789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-16',
 'seller_name': None,
 'title': 'Nissan Murano 3.5 V6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2005}
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-28 10:34:51 [auto1.de] INFO: Saving data for LC65511: {'auction_closing_time': 1774883227.0, 'created_time': 1773402304.385405, 'last_price_update_time': 1774694091.843407}
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC65511') HTTP/1.1" 204 0
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg not downloaded yet
2026-03-28 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:51 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [auto1.de] INFO: Scrape type for NH74164: 2
2026-03-28 10:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-28 10:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-28 10:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1, identifier: NH74164
2026-03-28 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT33018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-28 10:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-28 10:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164 to the API
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:58:58Z',
 'fuel_type': 'petrol',
 'id': 'c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH74164',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 127491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [auto1.de] INFO: Saving data for NH74164: {'auction_closing_time': 1774886338.0, 'created_time': 1774089330.75655, 'last_price_update_time': 1774694092.420301}
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH74164') HTTP/1.1" 204 0
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg not downloaded yet
2026-03-28 10:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55918550>
2026-03-28 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg saved to cache
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:52 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-28 10:34:52 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-28 10:34:52 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [auto1.de] INFO: Scrape type for CG50140: 2
2026-03-28 10:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-28 10:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-28 10:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 121ce847-36ec-551c-b0b2-bd2524907430, identifier: CG50140
2026-03-28 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR32471> (referer: https://www.auto1.com/v1/car-details-view/GR32471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-28 10:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-28 10:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140 to the API
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:46Z',
 'fuel_type': 'diesel',
 'id': '121ce847-36ec-551c-b0b2-bd2524907430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG50140',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 178371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [auto1.de] INFO: Saving data for CG50140: {'auction_closing_time': 1774884106.0, 'created_time': 1774349322.620311, 'last_price_update_time': 1774694092.95935}
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG50140') HTTP/1.1" 204 0
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_c25ce519d120006a45683af089391fef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_c25ce519d120006a45683af089391fef.jpg not downloaded yet
2026-03-28 10:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:53 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3c410>
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg saved to cache
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg not downloaded yet
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV36249> (referer: https://www.auto1.com/v1/car-details-view/RV36249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT95165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-28 10:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14343135-c4a8-59cd-a600-8b45a60a94b0 with scrape type 1
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14343135-c4a8-59cd-a600-8b45a60a94b0
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_9c95d195a20fb604eae19f67f906b742.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_9c95d195a20fb604eae19f67f906b742.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_2a5d84ff865c4c12424de109804b85df.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_2a5d84ff865c4c12424de109804b85df.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_83875209818f85e1702700cbba9802c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_83875209818f85e1702700cbba9802c0.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_f641981a3a08dd56b52a59bb0d19c906.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_f641981a3a08dd56b52a59bb0d19c906.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_7f2aeb11f96f6d0e10949ce9b8183cf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_7f2aeb11f96f6d0e10949ce9b8183cf7.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_82bbb9c395545bfabf62815925c4e204.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_82bbb9c395545bfabf62815925c4e204.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_fe1da613fcf5ce810dc5c949459fba03.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_fe1da613fcf5ce810dc5c949459fba03.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_156d41d48e8228022555759df161b230.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_156d41d48e8228022555759df161b230.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_21e252b0fe69c76582685828e8850b40.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_21e252b0fe69c76582685828e8850b40.jpg already downloaded
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F4d%252F934dde082002aa4e52e218be2df48119%252Fpa%252FGR32471_925345d43211fc9f4d25ad145cdba7de.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_925345d43211fc9f4d25ad145cdba7de.jpg already downloaded
2026-03-28 10:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14343135-c4a8-59cd-a600-8b45a60a94b0, identifier: GR32471
2026-03-28 10:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-28 10:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-28 10:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471 to the API
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR32471>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '14343135-c4a8-59cd-a600-8b45a60a94b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR32471',
 'listing': 'auction',
 'location': 'DE, Oberding',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 48275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_9c95d195a20fb604eae19f67f906b742.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_2a5d84ff865c4c12424de109804b85df.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_83875209818f85e1702700cbba9802c0.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_f641981a3a08dd56b52a59bb0d19c906.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_7f2aeb11f96f6d0e10949ce9b8183cf7.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_82bbb9c395545bfabf62815925c4e204.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_fe1da613fcf5ce810dc5c949459fba03.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_156d41d48e8228022555759df161b230.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_21e252b0fe69c76582685828e8850b40.jpg',
                'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_925345d43211fc9f4d25ad145cdba7de.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_9c95d195a20fb604eae19f67f906b742.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_2a5d84ff865c4c12424de109804b85df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_83875209818f85e1702700cbba9802c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_f641981a3a08dd56b52a59bb0d19c906.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_7f2aeb11f96f6d0e10949ce9b8183cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_82bbb9c395545bfabf62815925c4e204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_fe1da613fcf5ce810dc5c949459fba03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_156d41d48e8228022555759df161b230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_21e252b0fe69c76582685828e8850b40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14343135-c4a8-59cd-a600-8b45a60a94b0/14343135-c4a8-59cd-a600-8b45a60a94b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/4d/934dde082002aa4e52e218be2df48119/pa/GR32471_925345d43211fc9f4d25ad145cdba7de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [auto1.de] INFO: Saving data for GR32471: {'created_time': 1774694093.798396, 'last_price_update_time': 1774694093.798407, 'auction_closing_time': 1774886055.0}
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR32471') HTTP/1.1" 204 0
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_c25ce519d120006a45683af089391fef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec00d10>
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg saved to cache
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1b610>
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg saved to cache
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-28 10:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 1
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_01962f89423563441b7da2392dd625c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_01962f89423563441b7da2392dd625c7.jpg not downloaded yet
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_e92b3446a2ae40f6c525248e026fe43f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_e92b3446a2ae40f6c525248e026fe43f.jpg not downloaded yet
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac4610>
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_c25ce519d120006a45683af089391fef.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_c25ce519d120006a45683af089391fef.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb26c90>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg not downloaded yet
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_adaf1164f959564a8c471d93b653c1a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_adaf1164f959564a8c471d93b653c1a0.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY24352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_5e75562557b9adee7acedf5f13341222.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_5e75562557b9adee7acedf5f13341222.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_645463a1d3a644a63e06e636ee816bcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_645463a1d3a644a63e06e636ee816bcd.jpg not downloaded yet
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_adaf1164f959564a8c471d93b653c1a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_9244f2b0ce7c04064344d8e9b967318a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9244f2b0ce7c04064344d8e9b967318a.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_5a3989aa90e0cc71366e87729c3e287d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_62557428d427bdd57aabaced82ff037f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_9e0359d6d996fc23d4c494895409321e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9e0359d6d996fc23d4c494895409321e.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_3224205466840f5958fa40a05b783ca7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_3224205466840f5958fa40a05b783ca7.jpg not downloaded yet
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_92181527449fef6a83ea092635089af6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_5e75562557b9adee7acedf5f13341222.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6ab050>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c2250>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9244f2b0ce7c04064344d8e9b967318a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e93c610>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_adaf1164f959564a8c471d93b653c1a0.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_adaf1164f959564a8c471d93b653c1a0.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb24290>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_5a3989aa90e0cc71366e87729c3e287d.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_5a3989aa90e0cc71366e87729c3e287d.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb11110>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_62557428d427bdd57aabaced82ff037f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_62557428d427bdd57aabaced82ff037f.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1e910>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6ab6d0>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a3d10>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_92181527449fef6a83ea092635089af6.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_92181527449fef6a83ea092635089af6.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92d090>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_5e75562557b9adee7acedf5f13341222.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_5e75562557b9adee7acedf5f13341222.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:54 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9621 | hits on page: 40
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b6d50>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_9244f2b0ce7c04064344d8e9b967318a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9244f2b0ce7c04064344d8e9b967318a.jpg saved to cache
2026-03-28 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:54 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-28 10:34:54 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [auto1.de] INFO: Scrape type for YL16347: 1
2026-03-28 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK93979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:54 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-28 10:34:54 [auto1.de] INFO: Scrape type for MN41763: 1
2026-03-28 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebce1d0>
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg saved to cache
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Scrape type for SY55071: 2
2026-03-28 10:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-28 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-28 10:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738, identifier: SY55071
2026-03-28 10:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-28 10:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-28 10:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071 to the API
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'diesel',
 'id': '4dca0f26-20ff-5c8d-90cb-b2d373c3f738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY55071',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 32844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Saving data for SY55071: {'auction_closing_time': 1774884206.0, 'created_time': 1773469025.093341, 'last_price_update_time': 1774694095.591754}
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY55071') HTTP/1.1" 204 0
2026-03-28 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_01962f89423563441b7da2392dd625c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_e92b3446a2ae40f6c525248e026fe43f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_3224205466840f5958fa40a05b783ca7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Scrape type for WT57840: 1
2026-03-28 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ49235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec0b950>
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg saved to cache
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Scrape type for BZ34179: 1
2026-03-28 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Scrape type for GZ42240: 1
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: BB69200
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-28 10:34:55 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-28 10:34:55 [auto1.de] INFO: Scrape type for DZ63249: 2
2026-03-28 10:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-28 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-28 10:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb671b87-848e-544c-b050-858a564eed61, identifier: DZ63249
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f621f10>
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_01962f89423563441b7da2392dd625c7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_01962f89423563441b7da2392dd625c7.jpg saved to cache
2026-03-28 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55918dd0>
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_e92b3446a2ae40f6c525248e026fe43f.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_e92b3446a2ae40f6c525248e026fe43f.jpg saved to cache
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f778410>
2026-03-28 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_3224205466840f5958fa40a05b783ca7.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_3224205466840f5958fa40a05b783ca7.jpg saved to cache
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-28 10:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-28 10:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249 to the API
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': 'cb671b87-848e-544c-b050-858a564eed61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ63249',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 148748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-08',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-28 10:34:56 [auto1.de] INFO: Saving data for DZ63249: {'auction_closing_time': 1774883939.0, 'created_time': 1774032831.70904, 'last_price_update_time': 1774694096.387643}
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ63249') HTTP/1.1" 204 0
2026-03-28 10:34:56 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-28 10:34:56 [auto1.de] INFO: Scrape type for MN76950: 2
2026-03-28 10:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-28 10:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-28 10:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fddfe319-a9fe-5bed-9659-b7f3e9a236cc, identifier: MN76950
2026-03-28 10:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-28 10:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-28 10:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950 to the API
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:42Z',
 'fuel_type': 'diesel',
 'id': 'fddfe319-a9fe-5bed-9659-b7f3e9a236cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN76950',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 118990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2019}
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-28 10:34:56 [auto1.de] INFO: Saving data for MN76950: {'auction_closing_time': 1774885302.0, 'created_time': 1774350059.881302, 'last_price_update_time': 1774694096.960913}
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN76950') HTTP/1.1" 204 0
2026-03-28 10:34:56 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-28 10:34:56 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-28 10:34:56 [auto1.de] INFO: Scrape type for KV46000: 2
2026-03-28 10:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-28 10:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-28 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-28 10:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7ba12b-cf48-55f4-84ac-ba6f45290689, identifier: KV46000
2026-03-28 10:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-28 10:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-28 10:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000 to the API
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '4e7ba12b-cf48-55f4-84ac-ba6f45290689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV46000',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 113534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-28 10:34:57 [auto1.de] INFO: Saving data for KV46000: {'auction_closing_time': 1774882839.0, 'created_time': 1774089287.363021, 'last_price_update_time': 1774694097.424782}
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV46000') HTTP/1.1" 204 0
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: DM85467
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-28 10:34:57 [auto1.de] INFO: Scrape type for TA12646: 2
2026-03-28 10:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-28 10:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-28 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-28 10:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff, identifier: TA12646
2026-03-28 10:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-28 10:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-28 10:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646 to the API
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'petrol',
 'id': '47d593f1-d7b4-51d7-8bd1-7d59eff12fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA12646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 165255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': None,
 'title': 'BMW 4er M4 xDrive Competition',
 'transmission': 'automatic',
 'trim': 'xDrive Competition',
 'year': 2022}
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-28 10:34:57 [auto1.de] INFO: Saving data for TA12646: {'auction_closing_time': 1774884761.0, 'created_time': 1773301374.097241, 'last_price_update_time': 1774694097.906988}
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA12646') HTTP/1.1" 204 0
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-28 10:34:57 [auto1.de] INFO: Scrape type for LB45550: 1
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-28 10:34:57 [auto1.de] INFO: Scrape type for VG58612: 1
2026-03-28 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC79074> (referer: https://www.auto1.com/v1/car-details-view/EC79074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:34:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:34:57 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-28 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-28 10:34:58 [auto1.de] INFO: Scrape type for YC71395: 2
2026-03-28 10:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-28 10:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-28 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-28 10:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f42f13-401c-5f80-923b-2eb45551dce0, identifier: YC71395
2026-03-28 10:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-28 10:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-28 10:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395 to the API
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:43Z',
 'fuel_type': 'diesel',
 'id': 'c5f42f13-401c-5f80-923b-2eb45551dce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC71395',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 69107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-28 10:34:58 [auto1.de] INFO: Saving data for YC71395: {'auction_closing_time': 1774886323.0, 'created_time': 1773466897.330164, 'last_price_update_time': 1774694098.465434}
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC71395') HTTP/1.1" 204 0
2026-03-28 10:34:58 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-28 10:34:58 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-28 10:34:58 [auto1.de] INFO: Scrape type for SW39146: 2
2026-03-28 10:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-28 10:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-28 10:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-28 10:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 944e7e6f-0b17-54ff-baea-49d4542c53ef, identifier: SW39146
2026-03-28 10:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-28 10:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-28 10:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146 to the API
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:48:03Z',
 'fuel_type': 'petrol',
 'id': '944e7e6f-0b17-54ff-baea-49d4542c53ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW39146',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 76252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Jaguar XF 30t Sport AWD',
 'transmission': 'automatic',
 'trim': 'Sport AWD',
 'year': 2019}
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-28 10:34:58 [auto1.de] INFO: Saving data for SW39146: {'auction_closing_time': 1774885683.0, 'created_time': 1774349373.682184, 'last_price_update_time': 1774694098.945824}
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW39146') HTTP/1.1" 204 0
2026-03-28 10:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-28 10:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 1
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_c2be38a764a235aac06420eaf1e3a048.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg not downloaded yet
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for SS56268: 2
2026-03-28 10:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-28 10:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-28 10:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a09f128-aacd-51ad-a7f5-c28e24a60e69, identifier: SS56268
2026-03-28 10:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-28 10:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-28 10:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268 to the API
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:36:30Z',
 'fuel_type': 'petrol',
 'id': '1a09f128-aacd-51ad-a7f5-c28e24a60e69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS56268',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 57572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-17',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI R',
 'transmission': 'manual',
 'trim': 'R',
 'year': 2015}
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Saving data for SS56268: {'auction_closing_time': 1774884990.0, 'created_time': 1773917339.201921, 'last_price_update_time': 1774694099.535991}
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS56268') HTTP/1.1" 204 0
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_90b7509dce9105511d22aa99ab8312ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg not downloaded yet
2026-03-28 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for HM38388: 1
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_b98b188570308675b7a8adb66b8d1367.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg not downloaded yet
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for SA98041: 1
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_4dbf4f60c063fa18d57e4a768edac924.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg not downloaded yet
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for HS55924: 1
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_4654908980517e28d53bd5dc5efb7014.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg not downloaded yet
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for RM27503: 1
2026-03-28 10:34:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebcc910>
2026-03-28 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg') HTTP/1.1" 204 0
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg saved to cache
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_645463a1d3a644a63e06e636ee816bcd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_127cb6062745afe5bbcc6852453696e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg not downloaded yet
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-28 10:34:59 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-28 10:34:59 [auto1.de] INFO: Scrape type for GB23451: 2
2026-03-28 10:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-28 10:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-28 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-28 10:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc369c-9536-51ef-a70a-bc53d0d22c2b, identifier: GB23451
2026-03-28 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-28 10:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-28 10:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451 to the API
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:04:13Z',
 'fuel_type': 'diesel',
 'id': '03fc369c-9536-51ef-a70a-bc53d0d22c2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB23451',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 99114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-28 10:35:00 [auto1.de] INFO: Saving data for GB23451: {'auction_closing_time': 1774883053.0, 'created_time': 1774118663.627219, 'last_price_update_time': 1774694100.372856}
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB23451') HTTP/1.1" 204 0
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg not downloaded yet
2026-03-28 10:35:00 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-28 10:35:00 [auto1.de] INFO: Scrape type for GD85387: 2
2026-03-28 10:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-28 10:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-28 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-28 10:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d70cca7-8e41-5f63-82ab-48424c729afd, identifier: GD85387
2026-03-28 10:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-28 10:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-28 10:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387 to the API
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:42:57Z',
 'fuel_type': 'petrol',
 'id': '2d70cca7-8e41-5f63-82ab-48424c729afd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD85387',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'QX70',
 'odometer': 105983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Infiniti QX70 3.7 V6 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2016}
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-28 10:35:00 [auto1.de] INFO: Saving data for GD85387: {'auction_closing_time': 1774885377.0, 'created_time': 1774032896.056415, 'last_price_update_time': 1774694100.916731}
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD85387') HTTP/1.1" 204 0
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_bba59168ad8b93747b81517ec0ec26ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg not downloaded yet
2026-03-28 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY24352> (referer: https://www.auto1.com/v1/car-details-view/BY24352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d09d0>
2026-03-28 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_645463a1d3a644a63e06e636ee816bcd.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_645463a1d3a644a63e06e636ee816bcd.jpg saved to cache
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb35550>
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_90b7509dce9105511d22aa99ab8312ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg saved to cache
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_ab78776021350258c324ae6d332b5559.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg not downloaded yet
2026-03-28 10:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT95165> (referer: https://www.auto1.com/v1/car-details-view/KT95165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg not downloaded yet
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9e0359d6d996fc23d4c494895409321e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-28 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab459e5-aeb8-5306-a7da-d651b0564c61 with scrape type 1
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7ab459e5-aeb8-5306-a7da-d651b0564c61
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa0%252Fcfa0381f52df74e72ca0174427418c44%252Fpa%252FBY24352_c99ffb9bb5993b6752e8695759013dff.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_c99ffb9bb5993b6752e8695759013dff.jpg already downloaded
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa0%252Fcfa0381f52df74e72ca0174427418c44%252Fpa%252FBY24352_67bde02ac8c389576eecbb81e31d6b9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_67bde02ac8c389576eecbb81e31d6b9c.jpg already downloaded
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa0%252Fcfa0381f52df74e72ca0174427418c44%252Fpa%252FBY24352_7d1ec5ea9fd07d4d34f27436fa050e30.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_7d1ec5ea9fd07d4d34f27436fa050e30.jpg already downloaded
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa0%252Fcfa0381f52df74e72ca0174427418c44%252Fpa%252FBY24352_afd0f231b6287df5c3fc849c412b9845.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_afd0f231b6287df5c3fc849c412b9845.jpg already downloaded
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fa0%252Fcfa0381f52df74e72ca0174427418c44%252Fpa%252FBY24352_82affd35221f1e147725e2f014357c77.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_82affd35221f1e147725e2f014357c77.jpg already downloaded
2026-03-28 10:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab459e5-aeb8-5306-a7da-d651b0564c61, identifier: BY24352
2026-03-28 10:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-28 10:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-28 10:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352 to the API
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY24352>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:13:02Z',
 'fuel_type': 'petrol',
 'id': '7ab459e5-aeb8-5306-a7da-d651b0564c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY24352',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 190692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_c99ffb9bb5993b6752e8695759013dff.jpg',
                'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_67bde02ac8c389576eecbb81e31d6b9c.jpg',
                'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_7d1ec5ea9fd07d4d34f27436fa050e30.jpg',
                'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_afd0f231b6287df5c3fc849c412b9845.jpg',
                'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_82affd35221f1e147725e2f014357c77.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab459e5-aeb8-5306-a7da-d651b0564c61/7ab459e5-aeb8-5306-a7da-d651b0564c61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_c99ffb9bb5993b6752e8695759013dff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab459e5-aeb8-5306-a7da-d651b0564c61/7ab459e5-aeb8-5306-a7da-d651b0564c61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_67bde02ac8c389576eecbb81e31d6b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab459e5-aeb8-5306-a7da-d651b0564c61/7ab459e5-aeb8-5306-a7da-d651b0564c61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_7d1ec5ea9fd07d4d34f27436fa050e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab459e5-aeb8-5306-a7da-d651b0564c61/7ab459e5-aeb8-5306-a7da-d651b0564c61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_afd0f231b6287df5c3fc849c412b9845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab459e5-aeb8-5306-a7da-d651b0564c61/7ab459e5-aeb8-5306-a7da-d651b0564c61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/a0/cfa0381f52df74e72ca0174427418c44/pa/BY24352_82affd35221f1e147725e2f014357c77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [auto1.de] INFO: Saving data for BY24352: {'created_time': 1774694101.768542, 'last_price_update_time': 1774694101.768555, 'auction_closing_time': 1774883582.0}
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY24352') HTTP/1.1" 204 0
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL16347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN41763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-28 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 1
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg not downloaded yet
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92d550>
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_127cb6062745afe5bbcc6852453696e3.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg saved to cache
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecbaa90>
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F63%252F1463064c9cf5707538f2ce9cb5f9e413%252Fpa%252FRV36249_9e0359d6d996fc23d4c494895409321e.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9e0359d6d996fc23d4c494895409321e.jpg saved to cache
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1db3db65-0326-572c-81bf-2393918dec44
2026-03-28 10:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1db3db65-0326-572c-81bf-2393918dec44, skipping ID generation
2026-03-28 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 1
2026-03-28 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1db3db65-0326-572c-81bf-2393918dec44 sending to next pipeline
2026-03-28 10:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1db3db65-0326-572c-81bf-2393918dec44, identifier: RV36249
2026-03-28 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-28 10:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-28 10:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249 to the API
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9e0359d6d996fc23d4c494895409321e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'petrol',
 'id': '1db3db65-0326-572c-81bf-2393918dec44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV36249',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 137396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_01962f89423563441b7da2392dd625c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_e92b3446a2ae40f6c525248e026fe43f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_764d8e8e8ad96b8f8bf03db1cf989218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_adaf1164f959564a8c471d93b653c1a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_5e75562557b9adee7acedf5f13341222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_645463a1d3a644a63e06e636ee816bcd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_810a8e11c7dfb6359d3bbc0bb1c78ac2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9244f2b0ce7c04064344d8e9b967318a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_9e0359d6d996fc23d4c494895409321e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db3db65-0326-572c-81bf-2393918dec44/1db3db65-0326-572c-81bf-2393918dec44_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/63/1463064c9cf5707538f2ce9cb5f9e413/pa/RV36249_3224205466840f5958fa40a05b783ca7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-05-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2000}
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-28 10:35:02 [auto1.de] INFO: Saving data for RV36249: {'created_time': 1774694102.50061, 'last_price_update_time': 1774694102.500621, 'auction_closing_time': 1774885196.0}
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV36249') HTTP/1.1" 204 0
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_4d374132021f4575f8ffc0337bc656c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4d374132021f4575f8ffc0337bc656c4.jpg not downloaded yet
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebf2b50>
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_bba59168ad8b93747b81517ec0ec26ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg saved to cache
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg not downloaded yet
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_f56ec90723b99993989526e030c30515.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_f56ec90723b99993989526e030c30515.jpg not downloaded yet
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg not downloaded yet
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4b77a43e4bd2fba92ea622b104dce399.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b4b10>
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg saved to cache
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebba090>
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg saved to cache
2026-03-28 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_f56ec90723b99993989526e030c30515.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT33018> (referer: https://www.auto1.com/v1/car-details-view/BT33018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb25950>
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_4b77a43e4bd2fba92ea622b104dce399.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4b77a43e4bd2fba92ea622b104dce399.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e976390>
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79fc10>
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_4654908980517e28d53bd5dc5efb7014.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e977810>
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec01c90>
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_ab78776021350258c324ae6d332b5559.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e2cd0>
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_f56ec90723b99993989526e030c30515.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_f56ec90723b99993989526e030c30515.jpg saved to cache
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-28 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7fa6df-069b-5084-963f-b7b83500914f with scrape type 1
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c7fa6df-069b-5084-963f-b7b83500914f
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_f24822148d837c3844999c91076d8e72.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_f24822148d837c3844999c91076d8e72.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_8dbf385380b084f50b3d8bca1a6aa982.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8dbf385380b084f50b3d8bca1a6aa982.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_7150d39207118da6cece99cfa75059d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_7150d39207118da6cece99cfa75059d3.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_9f26779afd8b3932fd1a700533e9a8b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_9f26779afd8b3932fd1a700533e9a8b2.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_d5b50cf29d8406661ae8c99fec749ab1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_d5b50cf29d8406661ae8c99fec749ab1.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_21ba9765e9e5ed9fa05c8ae0d40f78a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_21ba9765e9e5ed9fa05c8ae0d40f78a5.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_af5fa06a541de558ed7d87550d2213f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_af5fa06a541de558ed7d87550d2213f4.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_14917bf9f9029e07d16b40c89af91f30.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_14917bf9f9029e07d16b40c89af91f30.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_8f483e59f16da17e8c88696102436e3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8f483e59f16da17e8c88696102436e3c.jpg already downloaded
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fab%252F91aba7dc465838b5a746b73b1170af67%252Fpa%252FBT33018_2fd8929f0030bccf7679f50a1db431f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_2fd8929f0030bccf7679f50a1db431f8.jpg already downloaded
2026-03-28 10:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7fa6df-069b-5084-963f-b7b83500914f, identifier: BT33018
2026-03-28 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-28 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-28 10:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018 to the API
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT33018>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '9c7fa6df-069b-5084-963f-b7b83500914f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT33018',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': '3er',
 'odometer': 97913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_f24822148d837c3844999c91076d8e72.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8dbf385380b084f50b3d8bca1a6aa982.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_7150d39207118da6cece99cfa75059d3.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_9f26779afd8b3932fd1a700533e9a8b2.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_d5b50cf29d8406661ae8c99fec749ab1.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_21ba9765e9e5ed9fa05c8ae0d40f78a5.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_af5fa06a541de558ed7d87550d2213f4.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_14917bf9f9029e07d16b40c89af91f30.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8f483e59f16da17e8c88696102436e3c.jpg',
                'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_2fd8929f0030bccf7679f50a1db431f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_f24822148d837c3844999c91076d8e72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8dbf385380b084f50b3d8bca1a6aa982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_7150d39207118da6cece99cfa75059d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_9f26779afd8b3932fd1a700533e9a8b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_d5b50cf29d8406661ae8c99fec749ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_21ba9765e9e5ed9fa05c8ae0d40f78a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_af5fa06a541de558ed7d87550d2213f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_14917bf9f9029e07d16b40c89af91f30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_8f483e59f16da17e8c88696102436e3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7fa6df-069b-5084-963f-b7b83500914f/9c7fa6df-069b-5084-963f-b7b83500914f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ab/91aba7dc465838b5a746b73b1170af67/pa/BT33018_2fd8929f0030bccf7679f50a1db431f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i GT Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-28 10:35:04 [auto1.de] INFO: Saving data for BT33018: {'created_time': 1774694104.084189, 'last_price_update_time': 1774694104.084201, 'auction_closing_time': 1774885795.0}
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT33018') HTTP/1.1" 204 0
2026-03-28 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4d374132021f4575f8ffc0337bc656c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e2990>
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg saved to cache
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7a76d0>
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg saved to cache
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea12850>
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F8f%252Fc48f767259b8915c7790c9dfd4df8274%252Fpa%252FKT95165_4d374132021f4575f8ffc0337bc656c4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4d374132021f4575f8ffc0337bc656c4.jpg saved to cache
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2512c744-7b0b-57cd-b201-b5465d76730b
2026-03-28 10:35:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2512c744-7b0b-57cd-b201-b5465d76730b, skipping ID generation
2026-03-28 10:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 1
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2512c744-7b0b-57cd-b201-b5465d76730b sending to next pipeline
2026-03-28 10:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2512c744-7b0b-57cd-b201-b5465d76730b, identifier: KT95165
2026-03-28 10:35:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f2d90>
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_4dbf4f60c063fa18d57e4a768edac924.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg saved to cache
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb37c50>
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_b98b188570308675b7a8adb66b8d1367.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg saved to cache
2026-03-28 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-28 10:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-28 10:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165 to the API
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4d374132021f4575f8ffc0337bc656c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'petrol',
 'id': '2512c744-7b0b-57cd-b201-b5465d76730b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT95165',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 100288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_3fc61c372c6b79037dd5c8c4d58d17f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4d374132021f4575f8ffc0337bc656c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_8c786984e5d74dd6bfc1d0109f1c7974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_f56ec90723b99993989526e030c30515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2512c744-7b0b-57cd-b201-b5465d76730b/2512c744-7b0b-57cd-b201-b5465d76730b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/8f/c48f767259b8915c7790c9dfd4df8274/pa/KT95165_4c89b6aea124fb97e7c8f81eeb7ba1a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-28 10:35:05 [auto1.de] INFO: Saving data for KT95165: {'created_time': 1774694105.035467, 'last_price_update_time': 1774694105.035477, 'auction_closing_time': 1774885739.0}
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT95165') HTTP/1.1" 204 0
2026-03-28 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB45550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX55294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb28690>
2026-03-28 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fc9%252F4bc9f7652317bc4695768504129f90a9%252Fpa%252FEC79074_c2be38a764a235aac06420eaf1e3a048.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg saved to cache
2026-03-28 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1daf73af-3354-5d41-a492-cd78cc06b189
2026-03-28 10:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1daf73af-3354-5d41-a492-cd78cc06b189, skipping ID generation
2026-03-28 10:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 1
2026-03-28 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1daf73af-3354-5d41-a492-cd78cc06b189 sending to next pipeline
2026-03-28 10:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1daf73af-3354-5d41-a492-cd78cc06b189, identifier: EC79074
2026-03-28 10:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-28 10:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-28 10:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074 to the API
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:44Z',
 'fuel_type': 'diesel',
 'id': '1daf73af-3354-5d41-a492-cd78cc06b189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79074',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 324456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_c2be38a764a235aac06420eaf1e3a048.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_90b7509dce9105511d22aa99ab8312ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3334379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_b98b188570308675b7a8adb66b8d1367.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3297105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4dbf4f60c063fa18d57e4a768edac924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3206524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_4654908980517e28d53bd5dc5efb7014.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_127cb6062745afe5bbcc6852453696e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3398748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_3338ebf0aab30fb6a213bbf1c955b85b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_bba59168ad8b93747b81517ec0ec26ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_ab78776021350258c324ae6d332b5559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1daf73af-3354-5d41-a492-cd78cc06b189/1daf73af-3354-5d41-a492-cd78cc06b189_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/c9/4bc9f7652317bc4695768504129f90a9/pa/EC79074_02a8f540d851cbe10365ac4cf3f3ebbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-28 10:35:05 [auto1.de] INFO: Saving data for EC79074: {'created_time': 1774694105.757887, 'last_price_update_time': 1774694105.757898, 'auction_closing_time': 1774884224.0}
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79074') HTTP/1.1" 204 0
2026-03-28 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS20271/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS55924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:06 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9623 | hits on page: 40
2026-03-28 10:35:06 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-28 10:35:06 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-28 10:35:06 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-28 10:35:06 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-28 10:35:06 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-28 10:35:06 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-28 10:35:06 [auto1.de] INFO: Scrape type for NW01608: 2
2026-03-28 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-28 10:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-28 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-28 10:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff, identifier: NW01608
2026-03-28 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-28 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-28 10:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608 to the API
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:46Z',
 'fuel_type': 'diesel',
 'id': '34fbe7c2-cfbe-51fe-ad8f-b648660b13ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01608',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 77001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Saving data for NW01608: {'auction_closing_time': 1774884046.0, 'created_time': 1774034112.135944, 'last_price_update_time': 1774694107.108067}
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01608') HTTP/1.1" 204 0
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for TY06085: 1
2026-03-28 10:35:07 [scrapy.extensions.logstats] INFO: Crawled 118 pages (at 76 pages/min), scraped 90 items (at 60 items/min)
2026-03-28 10:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA98041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for NU23342: 1
2026-03-28 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for FL62048: 1
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for MG84960: 1
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for KU56806: 2
2026-03-28 10:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-28 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-28 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-28 10:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea86f3eb-85a4-59f1-8270-431e62fee293, identifier: KU56806
2026-03-28 10:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-28 10:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-28 10:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806 to the API
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:08Z',
 'fuel_type': 'petrol',
 'id': 'ea86f3eb-85a4-59f1-8270-431e62fee293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU56806',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 109022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2010}
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Saving data for KU56806: {'auction_closing_time': 1774884608.0, 'created_time': 1774118750.988484, 'last_price_update_time': 1774694107.643772}
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU56806') HTTP/1.1" 204 0
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for YB04799: 1
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for ME28341: 1
2026-03-28 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM38388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-28 10:35:07 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-28 10:35:07 [auto1.de] INFO: Scrape type for AU10222: 2
2026-03-28 10:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-28 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-28 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-28 10:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be300ce-81a4-5545-899e-f30d43da3bbe, identifier: AU10222
2026-03-28 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-28 10:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-28 10:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222 to the API
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:37Z',
 'fuel_type': 'diesel',
 'id': '5be300ce-81a4-5545-899e-f30d43da3bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU10222',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 131251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Saving data for AU10222: {'auction_closing_time': 1774883197.0, 'created_time': 1774032207.91939, 'last_price_update_time': 1774694108.247004}
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU10222') HTTP/1.1" 204 0
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Scrape type for MN75028: 1
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Scrape type for SB90605: 2
2026-03-28 10:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-28 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-28 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-28 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85733017-482c-5aa5-ae3d-39c5cf1e9b63, identifier: SB90605
2026-03-28 10:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-28 10:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-28 10:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605 to the API
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'diesel',
 'id': '85733017-482c-5aa5-ae3d-39c5cf1e9b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB90605',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 166319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Saving data for SB90605: {'auction_closing_time': 1774885127.0, 'created_time': 1774033101.170897, 'last_price_update_time': 1774694108.6927}
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB90605') HTTP/1.1" 204 0
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Scrape type for HL93382: 1
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Scrape type for HU71027: 1
2026-03-28 10:35:08 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-28 10:35:08 [auto1.de] INFO: Scrape type for HW93754: 2
2026-03-28 10:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-28 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-28 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-28 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb8f772c-f708-53ca-a348-a48fc7e49114, identifier: HW93754
2026-03-28 10:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-28 10:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-28 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754 to the API
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:58:01Z',
 'fuel_type': 'petrol',
 'id': 'fb8f772c-f708-53ca-a348-a48fc7e49114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW93754',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 21109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-01',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Club 4x2',
 'transmission': 'manual',
 'trim': 'Club 4x2',
 'year': 2023}
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-28 10:35:09 [auto1.de] INFO: Saving data for HW93754: {'auction_closing_time': 1774886281.0, 'created_time': 1773467875.638911, 'last_price_update_time': 1774694109.276185}
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW93754') HTTP/1.1" 204 0
2026-03-28 10:35:09 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-28 10:35:09 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-28 10:35:09 [auto1.de] INFO: Scrape type for NB68023: 2
2026-03-28 10:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-28 10:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-28 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-28 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67f1478-1ed0-5810-9654-25dc38d68803, identifier: NB68023
2026-03-28 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-28 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-28 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023 to the API
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'diesel',
 'id': 'd67f1478-1ed0-5810-9654-25dc38d68803',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB68023',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 172423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-28 10:35:09 [auto1.de] INFO: Saving data for NB68023: {'auction_closing_time': 1774883127.0, 'created_time': 1773466604.492659, 'last_price_update_time': 1774694109.752197}
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB68023') HTTP/1.1" 204 0
2026-03-28 10:35:09 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-28 10:35:09 [auto1.de] INFO: Scrape type for BG93361: 2
2026-03-28 10:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-28 10:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-28 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-28 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 581f6631-be25-53cb-875a-77c2e6deaf86, identifier: BG93361
2026-03-28 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-28 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-28 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361 to the API
2026-03-28 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:15:51Z',
 'fuel_type': 'petrol',
 'id': '581f6631-be25-53cb-875a-77c2e6deaf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG93361',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 245520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-20',
 'seller_name': None,
 'title': 'Toyota Verso 1.8 Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2012}
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-28 10:35:10 [auto1.de] INFO: Saving data for BG93361: {'auction_closing_time': 1774883751.0, 'created_time': 1773468278.96402, 'last_price_update_time': 1774694110.221264}
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG93361') HTTP/1.1" 204 0
2026-03-28 10:35:10 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-28 10:35:10 [auto1.de] INFO: Scrape type for ZV32018: 1
2026-03-28 10:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ42240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:10 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-28 10:35:10 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-28 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL82798> (referer: https://www.auto1.com/v1/car-details-view/XL82798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-28 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 1
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_8ae8b1a3d02707ee654553a42508555e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ae8b1a3d02707ee654553a42508555e.jpg not downloaded yet
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg not downloaded yet
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg not downloaded yet
2026-03-28 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK93979> (referer: https://www.auto1.com/v1/car-details-view/BK93979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg not downloaded yet
2026-03-28 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_e0162109ad4d9b451d3437492fb7f80b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_e0162109ad4d9b451d3437492fb7f80b.jpg not downloaded yet
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_3682ff13ee1fd176cf26fec276f775fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_3682ff13ee1fd176cf26fec276f775fb.jpg not downloaded yet
2026-03-28 10:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-28 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with scrape type 1
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_80c871efaaf0238a4bdf4ef7dbf8f9a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_80c871efaaf0238a4bdf4ef7dbf8f9a7.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_adf75f5420549c48a01c26292818d876.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_adf75f5420549c48a01c26292818d876.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_62239525e4ffb62dcfa8249f01b4d9fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_62239525e4ffb62dcfa8249f01b4d9fd.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_add92f9147901c717668765c52e48d87.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_add92f9147901c717668765c52e48d87.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_b4fdb62e632e4e6d39254c87d48b1f05.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_b4fdb62e632e4e6d39254c87d48b1f05.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_efa640b0a93330a271724bfe0be93c62.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_efa640b0a93330a271724bfe0be93c62.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_816e6371adc8ce7ea46a68f9fe8e5573.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_816e6371adc8ce7ea46a68f9fe8e5573.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_61cdacd4f94d9e62b678c06cf8d93152.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_61cdacd4f94d9e62b678c06cf8d93152.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_5458212a138914e6fa1379c94cc17165.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_5458212a138914e6fa1379c94cc17165.jpg already downloaded
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fca%252F0eca6aea06b7b47e896e7f8699ceeee5%252Fpa%252FBK93979_e0b3ccfe3675b18a0ddca1430c458c69.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_e0b3ccfe3675b18a0ddca1430c458c69.jpg already downloaded
2026-03-28 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e, identifier: BK93979
2026-03-28 10:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-28 10:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-28 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979 to the API
2026-03-28 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BK93979>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:08Z',
 'fuel_type': 'diesel',
 'id': '6dea8a1c-b427-57fe-bd4e-7de622ccbc4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK93979',
 'listing': 'auction',
 'location': 'DE, Nürnberg Schweinau',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 89952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_80c871efaaf0238a4bdf4ef7dbf8f9a7.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_adf75f5420549c48a01c26292818d876.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_62239525e4ffb62dcfa8249f01b4d9fd.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_add92f9147901c717668765c52e48d87.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_b4fdb62e632e4e6d39254c87d48b1f05.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_efa640b0a93330a271724bfe0be93c62.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_816e6371adc8ce7ea46a68f9fe8e5573.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_61cdacd4f94d9e62b678c06cf8d93152.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_5458212a138914e6fa1379c94cc17165.jpg',
                'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_e0b3ccfe3675b18a0ddca1430c458c69.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_80c871efaaf0238a4bdf4ef7dbf8f9a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_adf75f5420549c48a01c26292818d876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_62239525e4ffb62dcfa8249f01b4d9fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_add92f9147901c717668765c52e48d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_b4fdb62e632e4e6d39254c87d48b1f05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_efa640b0a93330a271724bfe0be93c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_816e6371adc8ce7ea46a68f9fe8e5573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_61cdacd4f94d9e62b678c06cf8d93152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_5458212a138914e6fa1379c94cc17165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dea8a1c-b427-57fe-bd4e-7de622ccbc4e/6dea8a1c-b427-57fe-bd4e-7de622ccbc4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/ca/0eca6aea06b7b47e896e7f8699ceeee5/pa/BK93979_e0b3ccfe3675b18a0ddca1430c458c69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 2.0 Blue-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2018}
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-28 10:35:12 [auto1.de] INFO: Saving data for BK93979: {'created_time': 1774694112.198848, 'last_price_update_time': 1774694112.19886, 'auction_closing_time': 1774883468.0}
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK93979') HTTP/1.1" 204 0
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ34179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_e0162109ad4d9b451d3437492fb7f80b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f607450>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb35010>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_e0162109ad4d9b451d3437492fb7f80b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_e0162109ad4d9b451d3437492fb7f80b.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_3682ff13ee1fd176cf26fec276f775fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb37b10>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab4510>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_3682ff13ee1fd176cf26fec276f775fb.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_3682ff13ee1fd176cf26fec276f775fb.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ae8b1a3d02707ee654553a42508555e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f670e10>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab6050>
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa2%252Ff1a25d77967ccf723611467112ae32f6%252Fpa%252FXL82798_8ae8b1a3d02707ee654553a42508555e.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ae8b1a3d02707ee654553a42508555e.jpg saved to cache
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a02ad922-971e-54a5-8fdc-c6567d88302d
2026-03-28 10:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a02ad922-971e-54a5-8fdc-c6567d88302d, skipping ID generation
2026-03-28 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 1
2026-03-28 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a02ad922-971e-54a5-8fdc-c6567d88302d sending to next pipeline
2026-03-28 10:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a02ad922-971e-54a5-8fdc-c6567d88302d, identifier: XL82798
2026-03-28 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-28 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-28 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798 to the API
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ae8b1a3d02707ee654553a42508555e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:16:55Z',
 'fuel_type': 'petrol',
 'id': 'a02ad922-971e-54a5-8fdc-c6567d88302d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL82798',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Mazda',
 'model': '6',
 'odometer': 200178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ae8b1a3d02707ee654553a42508555e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_8ce49a7b0c48455fe31d3f161dbe1bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_48763af64d235fa2dbd242a7a6ebbfe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_521a30a9b0ff9f9d6d98cd8f4c030208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_e0162109ad4d9b451d3437492fb7f80b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02ad922-971e-54a5-8fdc-c6567d88302d/a02ad922-971e-54a5-8fdc-c6567d88302d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a2/f1a25d77967ccf723611467112ae32f6/pa/XL82798_3682ff13ee1fd176cf26fec276f775fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.0 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [auto1.de] INFO: Saving data for XL82798: {'created_time': 1774694113.341895, 'last_price_update_time': 1774694113.341905, 'auction_closing_time': 1774883815.0}
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL82798') HTTP/1.1" 204 0
2026-03-28 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL16347> (referer: https://www.auto1.com/v1/car-details-view/YL16347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-28 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 1
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_0e5e79f659cd9370f270cd6394da648d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0e5e79f659cd9370f270cd6394da648d.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_77d378daefc9596c0d13d1c803dada35.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_77d378daefc9596c0d13d1c803dada35.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_9a7b2584edc398c89fb7a264da492c8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9a7b2584edc398c89fb7a264da492c8d.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_1411a311aa002c00eace8f629cfcd97a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_1411a311aa002c00eace8f629cfcd97a.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg not downloaded yet
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_adc5453a9e58cb98880a552181fca6e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_adc5453a9e58cb98880a552181fca6e2.jpg not downloaded yet
2026-03-28 10:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX55294> (referer: https://www.auto1.com/v1/car-details-view/JX55294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-28 10:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd22b49-f425-52b7-9283-cf249c2f685b with scrape type 1
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dd22b49-f425-52b7-9283-cf249c2f685b
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_d3b6d7c28a25e7a174d6473c134bc312.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_d3b6d7c28a25e7a174d6473c134bc312.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_acb5926cc1cfb988f5fca6996e4d51c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_acb5926cc1cfb988f5fca6996e4d51c1.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_7ed26da36c165fcbaa848326c5fb2990.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7ed26da36c165fcbaa848326c5fb2990.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_ae95c0c1ba55e53765fbceb55b391530.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_ae95c0c1ba55e53765fbceb55b391530.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_b1d518937a5f0e6a71bef7a852f93865.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_b1d518937a5f0e6a71bef7a852f93865.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_41653fc4f70f29c67893805275675733.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_41653fc4f70f29c67893805275675733.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_7b69765410ee4508dc6a4767f1273355.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7b69765410ee4508dc6a4767f1273355.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_a0f34f35c340edb9f9b6c879fd098504.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a0f34f35c340edb9f9b6c879fd098504.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_f03682902c03b8e934d20e661be9cf08.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_f03682902c03b8e934d20e661be9cf08.jpg already downloaded
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fee%252Fbcee491c109cd151d76ad82ef00506e7%252Fpa%252FJX55294_a5dcbac13732e0e19e1f092f2598bb11.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a5dcbac13732e0e19e1f092f2598bb11.jpg already downloaded
2026-03-28 10:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dd22b49-f425-52b7-9283-cf249c2f685b, identifier: JX55294
2026-03-28 10:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-28 10:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-28 10:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294 to the API
2026-03-28 10:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JX55294>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:23:36Z',
 'fuel_type': 'diesel',
 'id': '8dd22b49-f425-52b7-9283-cf249c2f685b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX55294',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 204078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_d3b6d7c28a25e7a174d6473c134bc312.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_acb5926cc1cfb988f5fca6996e4d51c1.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7ed26da36c165fcbaa848326c5fb2990.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_ae95c0c1ba55e53765fbceb55b391530.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_b1d518937a5f0e6a71bef7a852f93865.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_41653fc4f70f29c67893805275675733.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7b69765410ee4508dc6a4767f1273355.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a0f34f35c340edb9f9b6c879fd098504.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_f03682902c03b8e934d20e661be9cf08.jpg',
                'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a5dcbac13732e0e19e1f092f2598bb11.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_d3b6d7c28a25e7a174d6473c134bc312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_acb5926cc1cfb988f5fca6996e4d51c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7ed26da36c165fcbaa848326c5fb2990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_ae95c0c1ba55e53765fbceb55b391530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_b1d518937a5f0e6a71bef7a852f93865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_41653fc4f70f29c67893805275675733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_7b69765410ee4508dc6a4767f1273355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a0f34f35c340edb9f9b6c879fd098504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_f03682902c03b8e934d20e661be9cf08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd22b49-f425-52b7-9283-cf249c2f685b/8dd22b49-f425-52b7-9283-cf249c2f685b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ee/bcee491c109cd151d76ad82ef00506e7/pa/JX55294_a5dcbac13732e0e19e1f092f2598bb11.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-28 10:35:17 [auto1.de] INFO: Saving data for JX55294: {'created_time': 1774694117.876477, 'last_price_update_time': 1774694117.876487, 'auction_closing_time': 1774884216.0}
2026-03-28 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX55294') HTTP/1.1" 204 0
2026-03-28 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_adc5453a9e58cb98880a552181fca6e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebcaf90>
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_adc5453a9e58cb98880a552181fca6e2.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_adc5453a9e58cb98880a552181fca6e2.jpg saved to cache
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea0bf10>
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg saved to cache
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_1411a311aa002c00eace8f629cfcd97a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaeeb90>
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_1411a311aa002c00eace8f629cfcd97a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_1411a311aa002c00eace8f629cfcd97a.jpg saved to cache
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea08550>
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg saved to cache
2026-03-28 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a1950>
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG58612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9a7b2584edc398c89fb7a264da492c8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecd4ad0>
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_9a7b2584edc398c89fb7a264da492c8d.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9a7b2584edc398c89fb7a264da492c8d.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_77d378daefc9596c0d13d1c803dada35.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0e5e79f659cd9370f270cd6394da648d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea23dd0>
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_77d378daefc9596c0d13d1c803dada35.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_77d378daefc9596c0d13d1c803dada35.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f673090>
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_0e5e79f659cd9370f270cd6394da648d.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0e5e79f659cd9370f270cd6394da648d.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2a3d0>
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebce450>
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1f%252F8f1f2040ff469118b8583f9313a6a514%252Fpa%252FYL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg saved to cache
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77132a8e-4535-57ec-b73e-078db3aa9b09
2026-03-28 10:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77132a8e-4535-57ec-b73e-078db3aa9b09, skipping ID generation
2026-03-28 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 1
2026-03-28 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77132a8e-4535-57ec-b73e-078db3aa9b09 sending to next pipeline
2026-03-28 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77132a8e-4535-57ec-b73e-078db3aa9b09, identifier: YL16347
2026-03-28 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-28 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-28 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347 to the API
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:39:02Z',
 'fuel_type': 'petrol',
 'id': '77132a8e-4535-57ec-b73e-078db3aa9b09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL16347',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 198958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_cc4a262b03ef35f90b346e5f98b6e84f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_c8325d634c0d9fbf31fabd9380e508eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0e5e79f659cd9370f270cd6394da648d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_77d378daefc9596c0d13d1c803dada35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9a7b2584edc398c89fb7a264da492c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3148298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_d9ff0a1b26d3b17ff905f11b152687aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_9f8ad148cd2af3280b9fab2afbbaf833.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_1411a311aa002c00eace8f629cfcd97a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_0fac06a1f2214b1a25b843ae0c5a613a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77132a8e-4535-57ec-b73e-078db3aa9b09/77132a8e-4535-57ec-b73e-078db3aa9b09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3148423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1f/8f1f2040ff469118b8583f9313a6a514/pa/YL16347_adc5453a9e58cb98880a552181fca6e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2017}
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-28 10:35:20 [auto1.de] INFO: Saving data for YL16347: {'created_time': 1774694120.426246, 'last_price_update_time': 1774694120.426257, 'auction_closing_time': 1774885142.0}
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL16347') HTTP/1.1" 204 0
2026-03-28 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT57840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME28341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY06085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA61115> (referer: https://www.auto1.com/v1/car-details-view/WA61115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-28 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 1
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_0e703c7299891c7b285cf8787a047b26.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0e703c7299891c7b285cf8787a047b26.jpg not downloaded yet
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg not downloaded yet
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_7f75a9aae1464985b734ac73076aa76c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_7f75a9aae1464985b734ac73076aa76c.jpg not downloaded yet
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_0ec6e2ad049101599111617f1a974fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0ec6e2ad049101599111617f1a974fa6.jpg not downloaded yet
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg not downloaded yet
2026-03-28 10:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS20271> (referer: https://www.auto1.com/v1/car-details-view/PS20271/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c078b81b-bcdb-5cb8-967a-89573defd49f with identifier: PS20271
2026-03-28 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c078b81b-bcdb-5cb8-967a-89573defd49f with scrape type 1
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_d71954f546d68624e068364f60429291.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_d71954f546d68624e068364f60429291.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_3d11001822f544a5f43cb4cdb9790e59.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3d11001822f544a5f43cb4cdb9790e59.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_34554e26011bf30b9081a06faddd7a28.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_34554e26011bf30b9081a06faddd7a28.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_cbe7556241f7259ccb84e93a2d995f68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_cbe7556241f7259ccb84e93a2d995f68.jpg not downloaded yet
2026-03-28 10:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_0416ad925124a9593cdcf0b23664f101.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_0416ad925124a9593cdcf0b23664f101.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg not downloaded yet
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg not downloaded yet
2026-03-28 10:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f785c10>
2026-03-28 10:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg saved to cache
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_cbe7556241f7259ccb84e93a2d995f68.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa3ed0>
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_cbe7556241f7259ccb84e93a2d995f68.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_cbe7556241f7259ccb84e93a2d995f68.jpg saved to cache
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa1c10>
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg saved to cache
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea20310>
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg saved to cache
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV32018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_0416ad925124a9593cdcf0b23664f101.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab6810>
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg saved to cache
2026-03-28 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa2a10>
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_0416ad925124a9593cdcf0b23664f101.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_0416ad925124a9593cdcf0b23664f101.jpg saved to cache
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2f3d0>
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg saved to cache
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_34554e26011bf30b9081a06faddd7a28.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea70b90>
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_34554e26011bf30b9081a06faddd7a28.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_34554e26011bf30b9081a06faddd7a28.jpg saved to cache
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3d11001822f544a5f43cb4cdb9790e59.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f606d50>
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_3d11001822f544a5f43cb4cdb9790e59.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3d11001822f544a5f43cb4cdb9790e59.jpg saved to cache
2026-03-28 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea20310>
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg saved to cache
2026-03-28 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_d71954f546d68624e068364f60429291.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebcfa50>
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F16%252Fa31661b157ef6471257a8fe99717c27b%252Fpa%252FPS20271_d71954f546d68624e068364f60429291.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_d71954f546d68624e068364f60429291.jpg saved to cache
2026-03-28 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c078b81b-bcdb-5cb8-967a-89573defd49f
2026-03-28 10:35:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c078b81b-bcdb-5cb8-967a-89573defd49f, skipping ID generation
2026-03-28 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c078b81b-bcdb-5cb8-967a-89573defd49f with scrape type 1
2026-03-28 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c078b81b-bcdb-5cb8-967a-89573defd49f sending to next pipeline
2026-03-28 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c078b81b-bcdb-5cb8-967a-89573defd49f, identifier: PS20271
2026-03-28 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c078b81b-bcdb-5cb8-967a-89573defd49f with identifier: PS20271
2026-03-28 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c078b81b-bcdb-5cb8-967a-89573defd49f with identifier: PS20271
2026-03-28 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c078b81b-bcdb-5cb8-967a-89573defd49f with identifier: PS20271 to the API
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_d71954f546d68624e068364f60429291.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:24:46Z',
 'fuel_type': 'petrol',
 'id': 'c078b81b-bcdb-5cb8-967a-89573defd49f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS20271',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Mazda',
 'model': '6',
 'odometer': 283403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3249390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_d71954f546d68624e068364f60429291.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3286222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_c7760ae4cb0e671722dd4dc22bf5d643.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3d11001822f544a5f43cb4cdb9790e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_34554e26011bf30b9081a06faddd7a28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3400168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_5a0eb24087a4c346e4b1e0895b5ae670.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3185083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_cbe7556241f7259ccb84e93a2d995f68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_0416ad925124a9593cdcf0b23664f101.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_e0c016d3b6512650d4b3a00b5db2363f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_8ea9f06da2708dbd6da42c4e422c37dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c078b81b-bcdb-5cb8-967a-89573defd49f/c078b81b-bcdb-5cb8-967a-89573defd49f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/16/a31661b157ef6471257a8fe99717c27b/pa/PS20271_3bb36586305dfc6bc0aee211f20ebc57.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS20271%27 HTTP/1.1" 200 None
2026-03-28 10:35:27 [auto1.de] INFO: Saving data for PS20271: {'created_time': 1774694127.85219, 'last_price_update_time': 1774694127.852201, 'auction_closing_time': 1774884286.0}
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS20271') HTTP/1.1" 204 0
2026-03-28 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0ec6e2ad049101599111617f1a974fa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f777750>
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_0ec6e2ad049101599111617f1a974fa6.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0ec6e2ad049101599111617f1a974fa6.jpg saved to cache
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_7f75a9aae1464985b734ac73076aa76c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecbb450>
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_7f75a9aae1464985b734ac73076aa76c.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_7f75a9aae1464985b734ac73076aa76c.jpg saved to cache
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0e703c7299891c7b285cf8787a047b26.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2acd0>
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg saved to cache
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea09650>
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6c%252F9d6cd846097f94d618fd82ca448fc29e%252Fpa%252FWA61115_0e703c7299891c7b285cf8787a047b26.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0e703c7299891c7b285cf8787a047b26.jpg saved to cache
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 564f935f-1fa8-5d14-af3c-585d82b9cefa
2026-03-28 10:35:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 564f935f-1fa8-5d14-af3c-585d82b9cefa, skipping ID generation
2026-03-28 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 1
2026-03-28 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 564f935f-1fa8-5d14-af3c-585d82b9cefa sending to next pipeline
2026-03-28 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 564f935f-1fa8-5d14-af3c-585d82b9cefa, identifier: WA61115
2026-03-28 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-28 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-28 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115 to the API
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0e703c7299891c7b285cf8787a047b26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:37:04Z',
 'fuel_type': 'petrol',
 'id': '564f935f-1fa8-5d14-af3c-585d82b9cefa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA61115',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 14643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0e703c7299891c7b285cf8787a047b26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_6ceb4bce39365a5ba41e9c4e0f3ab806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_7f75a9aae1464985b734ac73076aa76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_0ec6e2ad049101599111617f1a974fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564f935f-1fa8-5d14-af3c-585d82b9cefa/564f935f-1fa8-5d14-af3c-585d82b9cefa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6c/9d6cd846097f94d618fd82ca448fc29e/pa/WA61115_ecef7fb2edc16112ef901eb5a95f0c93.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-08-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2003}
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-28 10:35:28 [auto1.de] INFO: Saving data for WA61115: {'created_time': 1774694128.855788, 'last_price_update_time': 1774694128.855802, 'auction_closing_time': 1774885024.0}
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA61115') HTTP/1.1" 204 0
2026-03-28 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL93382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB45550> (referer: https://www.auto1.com/v1/car-details-view/LB45550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-28 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb with scrape type 1
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_290e9cb64674f33dd3c7f57719239d47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_290e9cb64674f33dd3c7f57719239d47.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_d41b663c2cdea7ad72001b4a495c4e47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_d41b663c2cdea7ad72001b4a495c4e47.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_9f6ade39fbae813f5be767a1c4d14039.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_9f6ade39fbae813f5be767a1c4d14039.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_332861dbd3412927d11633e1edb3e4af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_332861dbd3412927d11633e1edb3e4af.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_34c2ca7cae2c793e637ce449b4c0e626.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_34c2ca7cae2c793e637ce449b4c0e626.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_caa4336b5403f5edefd1bb529288c994.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_caa4336b5403f5edefd1bb529288c994.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_4d89d8698a1b03ed9f3bb7ce63b847da.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_4d89d8698a1b03ed9f3bb7ce63b847da.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_ca6d16b1692259eb407a55953dfd85dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ca6d16b1692259eb407a55953dfd85dc.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_a7fda661e2acd32f7c2ad6dd79e60842.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_a7fda661e2acd32f7c2ad6dd79e60842.jpg already downloaded
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fee%252F77ee409f9f71f7df1e5bf9a514e94579%252Fpa%252FLB45550_ad413e5eac99fa35af48e9b9debf4882.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ad413e5eac99fa35af48e9b9debf4882.jpg already downloaded
2026-03-28 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cef1c38-31d0-5cac-90d6-b1af3864eddb, identifier: LB45550
2026-03-28 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-28 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-28 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550 to the API
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LB45550>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:02:34Z',
 'fuel_type': 'petrol',
 'id': '6cef1c38-31d0-5cac-90d6-b1af3864eddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB45550',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 153567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_290e9cb64674f33dd3c7f57719239d47.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_d41b663c2cdea7ad72001b4a495c4e47.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_9f6ade39fbae813f5be767a1c4d14039.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_332861dbd3412927d11633e1edb3e4af.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_34c2ca7cae2c793e637ce449b4c0e626.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_caa4336b5403f5edefd1bb529288c994.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_4d89d8698a1b03ed9f3bb7ce63b847da.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ca6d16b1692259eb407a55953dfd85dc.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_a7fda661e2acd32f7c2ad6dd79e60842.jpg',
                'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ad413e5eac99fa35af48e9b9debf4882.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63061,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_290e9cb64674f33dd3c7f57719239d47.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62681,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_d41b663c2cdea7ad72001b4a495c4e47.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52712,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_9f6ade39fbae813f5be767a1c4d14039.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37283,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_332861dbd3412927d11633e1edb3e4af.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49185,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_34c2ca7cae2c793e637ce449b4c0e626.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54967,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_caa4336b5403f5edefd1bb529288c994.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38309,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_4d89d8698a1b03ed9f3bb7ce63b847da.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55744,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ca6d16b1692259eb407a55953dfd85dc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50825,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_a7fda661e2acd32f7c2ad6dd79e60842.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cef1c38-31d0-5cac-90d6-b1af3864eddb/6cef1c38-31d0-5cac-90d6-b1af3864eddb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37879,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ee/77ee409f9f71f7df1e5bf9a514e94579/pa/LB45550_ad413e5eac99fa35af48e9b9debf4882.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Prime-Line',
 'transmission': 'manual',
 'trim': 'Prime-Line',
 'year': 2019}
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-28 10:35:30 [auto1.de] INFO: Saving data for LB45550: {'created_time': 1774694130.866996, 'last_price_update_time': 1774694130.867007, 'auction_closing_time': 1774882954.0}
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB45550') HTTP/1.1" 204 0
2026-03-28 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ42240> (referer: https://www.auto1.com/v1/car-details-view/GZ42240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-28 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6aabce2-599c-5322-956f-d3aae5c6ca07 with scrape type 1
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6aabce2-599c-5322-956f-d3aae5c6ca07
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_53b0cf810d5f704ebcd113599119743b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_53b0cf810d5f704ebcd113599119743b.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_08cb7b61cc80f45824646efa9ae5c767.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08cb7b61cc80f45824646efa9ae5c767.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_f155ec757018164cd0dec8d20b0e0a6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_f155ec757018164cd0dec8d20b0e0a6f.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_4471ffaa5b1668913f374bab7e498f21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_4471ffaa5b1668913f374bab7e498f21.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_a93b83e6b18d10f028528918ff00b712.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_a93b83e6b18d10f028528918ff00b712.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_098a87b859e2190ce29a9e73afdf006f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_098a87b859e2190ce29a9e73afdf006f.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_2f21662bdb034a6cc506af5cd8b0cd4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_2f21662bdb034a6cc506af5cd8b0cd4b.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_08645298eea20e6974a099c61f7c9271.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08645298eea20e6974a099c61f7c9271.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_9140773a85974453bf767c85f80e4d25.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_9140773a85974453bf767c85f80e4d25.jpg already downloaded
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F37%252Ff13707d7ea6ba72f9cfc5ac068b58f7e%252Fpa%252FGZ42240_885e69be0b15cc505786d3a4c46b09e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_885e69be0b15cc505786d3a4c46b09e3.jpg already downloaded
2026-03-28 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6aabce2-599c-5322-956f-d3aae5c6ca07, identifier: GZ42240
2026-03-28 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-28 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-28 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240 to the API
2026-03-28 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ42240>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'petrol',
 'id': 'f6aabce2-599c-5322-956f-d3aae5c6ca07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ42240',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 82450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_53b0cf810d5f704ebcd113599119743b.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08cb7b61cc80f45824646efa9ae5c767.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_f155ec757018164cd0dec8d20b0e0a6f.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_4471ffaa5b1668913f374bab7e498f21.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_a93b83e6b18d10f028528918ff00b712.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_098a87b859e2190ce29a9e73afdf006f.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_2f21662bdb034a6cc506af5cd8b0cd4b.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08645298eea20e6974a099c61f7c9271.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_9140773a85974453bf767c85f80e4d25.jpg',
                'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_885e69be0b15cc505786d3a4c46b09e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_53b0cf810d5f704ebcd113599119743b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3334026,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08cb7b61cc80f45824646efa9ae5c767.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_f155ec757018164cd0dec8d20b0e0a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_4471ffaa5b1668913f374bab7e498f21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_a93b83e6b18d10f028528918ff00b712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_098a87b859e2190ce29a9e73afdf006f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_2f21662bdb034a6cc506af5cd8b0cd4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_08645298eea20e6974a099c61f7c9271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3266413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_9140773a85974453bf767c85f80e4d25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6aabce2-599c-5322-956f-d3aae5c6ca07/f6aabce2-599c-5322-956f-d3aae5c6ca07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/37/f13707d7ea6ba72f9cfc5ac068b58f7e/pa/GZ42240_885e69be0b15cc505786d3a4c46b09e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MINI Roadster Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-28 10:35:34 [auto1.de] INFO: Saving data for GZ42240: {'created_time': 1774694134.148665, 'last_price_update_time': 1774694134.148679, 'auction_closing_time': 1774883726.0}
2026-03-28 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ42240') HTTP/1.1" 204 0
2026-03-28 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN75028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG58612> (referer: https://www.auto1.com/v1/car-details-view/VG58612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-28 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with scrape type 1
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_355d0a0415efa5aaa2e926c11dcd7369.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_355d0a0415efa5aaa2e926c11dcd7369.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_1e2af27671617442f19d7f382673e374.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1e2af27671617442f19d7f382673e374.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_1d846b407b9a5a3dae3b966ee41d2451.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1d846b407b9a5a3dae3b966ee41d2451.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_be838b999adfbf1373d4e47a05ce4b4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_be838b999adfbf1373d4e47a05ce4b4a.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_8ca83a51425d2c3ce5eeede072aa8768.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_8ca83a51425d2c3ce5eeede072aa8768.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_48dc707e1caea4b20076257da1d8bfaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_48dc707e1caea4b20076257da1d8bfaf.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_c293eacbcb519f4231661b572fa995d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c293eacbcb519f4231661b572fa995d9.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_765e7e9c3ea970618865bea289ca0543.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_765e7e9c3ea970618865bea289ca0543.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_fdffa291d44a4e4a5daad833f0e507b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_fdffa291d44a4e4a5daad833f0e507b3.jpg already downloaded
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fcc%252F13cca417d4b8b5021167af07b7450b21%252Fpa%252FVG58612_c8c2fcb65617ba6b6c445ae0ee8e9ae6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c8c2fcb65617ba6b6c445ae0ee8e9ae6.jpg already downloaded
2026-03-28 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c, identifier: VG58612
2026-03-28 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-28 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-28 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612 to the API
2026-03-28 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG58612>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:41Z',
 'fuel_type': 'diesel',
 'id': '1a19348c-d2db-58bd-a3fb-68f2cbd7d55c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG58612',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 187854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_355d0a0415efa5aaa2e926c11dcd7369.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1e2af27671617442f19d7f382673e374.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1d846b407b9a5a3dae3b966ee41d2451.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_be838b999adfbf1373d4e47a05ce4b4a.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_8ca83a51425d2c3ce5eeede072aa8768.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_48dc707e1caea4b20076257da1d8bfaf.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c293eacbcb519f4231661b572fa995d9.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_765e7e9c3ea970618865bea289ca0543.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_fdffa291d44a4e4a5daad833f0e507b3.jpg',
                'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c8c2fcb65617ba6b6c445ae0ee8e9ae6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_355d0a0415efa5aaa2e926c11dcd7369.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1e2af27671617442f19d7f382673e374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_1d846b407b9a5a3dae3b966ee41d2451.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_be838b999adfbf1373d4e47a05ce4b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_8ca83a51425d2c3ce5eeede072aa8768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_48dc707e1caea4b20076257da1d8bfaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c293eacbcb519f4231661b572fa995d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_765e7e9c3ea970618865bea289ca0543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_fdffa291d44a4e4a5daad833f0e507b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a19348c-d2db-58bd-a3fb-68f2cbd7d55c/1a19348c-d2db-58bd-a3fb-68f2cbd7d55c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/cc/13cca417d4b8b5021167af07b7450b21/pa/VG58612_c8c2fcb65617ba6b6c445ae0ee8e9ae6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Premium Edition',
 'transmission': 'automatic',
 'trim': 'Premium Edition',
 'year': 2018}
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [auto1.de] INFO: Saving data for VG58612: {'created_time': 1774694136.238401, 'last_price_update_time': 1774694136.238421, 'auction_closing_time': 1774885301.0}
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG58612') HTTP/1.1" 204 0
2026-03-28 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT57840> (referer: https://www.auto1.com/v1/car-details-view/WT57840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-28 10:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 1
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg not downloaded yet
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg not downloaded yet
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg not downloaded yet
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg not downloaded yet
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg not downloaded yet
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_2ebb40385508387a3d0730f772c0330c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2ebb40385508387a3d0730f772c0330c.jpg not downloaded yet
2026-03-28 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM38388> (referer: https://www.auto1.com/v1/car-details-view/HM38388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2ebb40385508387a3d0730f772c0330c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-28 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a11244-40b5-52af-90ab-6bd4f8219b42 with scrape type 1
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 11a11244-40b5-52af-90ab-6bd4f8219b42
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fcf%252F52cf7a1a7019d24f977a1271175987ff%252Fpa%252FHM38388_8f73feae4bac6951fd06a7b3890b36a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8f73feae4bac6951fd06a7b3890b36a3.jpg already downloaded
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fcf%252F52cf7a1a7019d24f977a1271175987ff%252Fpa%252FHM38388_8b0171f7737095bc36d58281df2322dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8b0171f7737095bc36d58281df2322dc.jpg already downloaded
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fcf%252F52cf7a1a7019d24f977a1271175987ff%252Fpa%252FHM38388_7301be14cd80ff992b52ef090da9f881.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_7301be14cd80ff992b52ef090da9f881.jpg already downloaded
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fcf%252F52cf7a1a7019d24f977a1271175987ff%252Fpa%252FHM38388_997c9c8e079d0dbcce9677a75ffbc33d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_997c9c8e079d0dbcce9677a75ffbc33d.jpg already downloaded
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fcf%252F52cf7a1a7019d24f977a1271175987ff%252Fpa%252FHM38388_c105f7c92af28e0ffb530adde30641e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_c105f7c92af28e0ffb530adde30641e6.jpg already downloaded
2026-03-28 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11a11244-40b5-52af-90ab-6bd4f8219b42, identifier: HM38388
2026-03-28 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-28 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-28 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388 to the API
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM38388>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:42Z',
 'fuel_type': 'petrol',
 'id': '11a11244-40b5-52af-90ab-6bd4f8219b42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM38388',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8f73feae4bac6951fd06a7b3890b36a3.jpg',
                'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8b0171f7737095bc36d58281df2322dc.jpg',
                'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_7301be14cd80ff992b52ef090da9f881.jpg',
                'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_997c9c8e079d0dbcce9677a75ffbc33d.jpg',
                'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_c105f7c92af28e0ffb530adde30641e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a11244-40b5-52af-90ab-6bd4f8219b42/11a11244-40b5-52af-90ab-6bd4f8219b42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8f73feae4bac6951fd06a7b3890b36a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a11244-40b5-52af-90ab-6bd4f8219b42/11a11244-40b5-52af-90ab-6bd4f8219b42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_8b0171f7737095bc36d58281df2322dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a11244-40b5-52af-90ab-6bd4f8219b42/11a11244-40b5-52af-90ab-6bd4f8219b42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_7301be14cd80ff992b52ef090da9f881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a11244-40b5-52af-90ab-6bd4f8219b42/11a11244-40b5-52af-90ab-6bd4f8219b42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_997c9c8e079d0dbcce9677a75ffbc33d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11a11244-40b5-52af-90ab-6bd4f8219b42/11a11244-40b5-52af-90ab-6bd4f8219b42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/cf/52cf7a1a7019d24f977a1271175987ff/pa/HM38388_c105f7c92af28e0ffb530adde30641e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2001}
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-28 10:35:38 [auto1.de] INFO: Saving data for HM38388: {'created_time': 1774694138.89955, 'last_price_update_time': 1774694138.899562, 'auction_closing_time': 1774885542.0}
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM38388') HTTP/1.1" 204 0
2026-03-28 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f59fa90>
2026-03-28 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_2ebb40385508387a3d0730f772c0330c.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2ebb40385508387a3d0730f772c0330c.jpg saved to cache
2026-03-28 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bd990>
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg saved to cache
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab6910>
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg saved to cache
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebc9310>
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg saved to cache
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab5ed0>
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg saved to cache
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f621890>
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F9d%252F3a9d313c14038dd922b85269b52877b9%252Fpa%252FWT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg saved to cache
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02
2026-03-28 10:35:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02, skipping ID generation
2026-03-28 10:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 1
2026-03-28 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 sending to next pipeline
2026-03-28 10:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02, identifier: WT57840
2026-03-28 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-28 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-28 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840 to the API
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'petrol',
 'id': '9e5dce97-6cd0-5aed-958f-d378e5b9ac02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT57840',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 78405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_aa0b05eb4c8c883e0df1ca80d46f07a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_04c6efd63b0cf4c662ceb41538372a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2309e63b49c6584a76b99fd437bfc1d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_759722d177a1f6922d2d30e5cdaed1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_6d5761eb14a0a756ea2dc6ad724105f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5dce97-6cd0-5aed-958f-d378e5b9ac02/9e5dce97-6cd0-5aed-958f-d378e5b9ac02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/9d/3a9d313c14038dd922b85269b52877b9/pa/WT57840_2ebb40385508387a3d0730f772c0330c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2015}
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [auto1.de] INFO: Saving data for WT57840: {'created_time': 1774694140.114666, 'last_price_update_time': 1774694140.11468, 'auction_closing_time': 1774884311.0}
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT57840') HTTP/1.1" 204 0
2026-03-28 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ34179> (referer: https://www.auto1.com/v1/car-details-view/BZ34179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-28 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f445c9-22bc-57d0-ba5e-3c55a890873f with scrape type 1
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2f445c9-22bc-57d0-ba5e-3c55a890873f
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_7133d713597babd8a769642163f0f7e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_7133d713597babd8a769642163f0f7e0.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_41723a08ba2b0acf4a8695b24515c92e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_41723a08ba2b0acf4a8695b24515c92e.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_56d3509a198b80f3ff35a66331b1774a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_56d3509a198b80f3ff35a66331b1774a.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_fa25d8badd35f05f8aa9c212a9e8bf49.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_fa25d8badd35f05f8aa9c212a9e8bf49.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_0f6157b5868cd0bbe4a95edc8fed1d65.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_0f6157b5868cd0bbe4a95edc8fed1d65.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_6a692001141f248c5e58ed5e3ef29fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_6a692001141f248c5e58ed5e3ef29fe0.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_c0a48d3ffb3f1ae9e556d58eb565912f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c0a48d3ffb3f1ae9e556d58eb565912f.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_c8303765d1dc243b3b151ede4e17a5fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c8303765d1dc243b3b151ede4e17a5fe.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_94e8df69a858dd7897f7e3ebdbbbc6fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_94e8df69a858dd7897f7e3ebdbbbc6fe.jpg already downloaded
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F05%252F8b05262fe012bbc4ce13a7b7977664fa%252Fpa%252FBZ34179_72ebaec4968ccbd5ab88cceb7e45a8f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_72ebaec4968ccbd5ab88cceb7e45a8f0.jpg already downloaded
2026-03-28 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f445c9-22bc-57d0-ba5e-3c55a890873f, identifier: BZ34179
2026-03-28 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-28 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-28 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179 to the API
2026-03-28 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ34179>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:38:30Z',
 'fuel_type': 'petrol',
 'id': 'f2f445c9-22bc-57d0-ba5e-3c55a890873f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34179',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 44697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_7133d713597babd8a769642163f0f7e0.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_41723a08ba2b0acf4a8695b24515c92e.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_56d3509a198b80f3ff35a66331b1774a.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_fa25d8badd35f05f8aa9c212a9e8bf49.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_0f6157b5868cd0bbe4a95edc8fed1d65.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_6a692001141f248c5e58ed5e3ef29fe0.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c0a48d3ffb3f1ae9e556d58eb565912f.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c8303765d1dc243b3b151ede4e17a5fe.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_94e8df69a858dd7897f7e3ebdbbbc6fe.jpg',
                'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_72ebaec4968ccbd5ab88cceb7e45a8f0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_7133d713597babd8a769642163f0f7e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_41723a08ba2b0acf4a8695b24515c92e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_56d3509a198b80f3ff35a66331b1774a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_fa25d8badd35f05f8aa9c212a9e8bf49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_0f6157b5868cd0bbe4a95edc8fed1d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_6a692001141f248c5e58ed5e3ef29fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c0a48d3ffb3f1ae9e556d58eb565912f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_c8303765d1dc243b3b151ede4e17a5fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_94e8df69a858dd7897f7e3ebdbbbc6fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f445c9-22bc-57d0-ba5e-3c55a890873f/f2f445c9-22bc-57d0-ba5e-3c55a890873f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/05/8b05262fe012bbc4ce13a7b7977664fa/pa/BZ34179_72ebaec4968ccbd5ab88cceb7e45a8f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort+ 4x2',
 'transmission': 'manual',
 'trim': 'Comfort+ 4x2',
 'year': 2021}
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [auto1.de] INFO: Saving data for BZ34179: {'created_time': 1774694141.399521, 'last_price_update_time': 1774694141.399535, 'auction_closing_time': 1774885110.0}
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ34179') HTTP/1.1" 204 0
2026-03-28 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY06085> (referer: https://www.auto1.com/v1/car-details-view/TY06085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV32018> (referer: https://www.auto1.com/v1/car-details-view/ZV32018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-28 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce86a12-6770-5592-a386-5a5a62d50f10 with scrape type 1
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce86a12-6770-5592-a386-5a5a62d50f10
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_ea37e4675aa876e29a95b195b72c2af3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_ea37e4675aa876e29a95b195b72c2af3.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_5d438164e180e9a78e6d1cbc6d34c203.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_5d438164e180e9a78e6d1cbc6d34c203.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_21dba6f1886a299e39d88b5b55a8bcd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_21dba6f1886a299e39d88b5b55a8bcd6.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_3cc74fab30cc5cb0a8cd326b06dcb423.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_3cc74fab30cc5cb0a8cd326b06dcb423.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_4b6a3fdbb6672f4900052c168fe7fcbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_4b6a3fdbb6672f4900052c168fe7fcbf.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_8732b8c0547cea086a91098ec3959d43.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_8732b8c0547cea086a91098ec3959d43.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_67ea5c67f9ea335cbba83ee3d4efdce8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_67ea5c67f9ea335cbba83ee3d4efdce8.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_c6979175b953f608dbb32e7405cc98e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_c6979175b953f608dbb32e7405cc98e7.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_fd05bfc1b1dd1f1f56f720ae8075cb44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_fd05bfc1b1dd1f1f56f720ae8075cb44.jpg already downloaded
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fbc%252Fe8bc403282ecb6d4d8cb5bd31510eb95%252Fpa%252FTY06085_382fa60e7c58031fa94cb5f40c65990d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_382fa60e7c58031fa94cb5f40c65990d.jpg already downloaded
2026-03-28 10:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bce86a12-6770-5592-a386-5a5a62d50f10, identifier: TY06085
2026-03-28 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-28 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 1
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg not downloaded yet
2026-03-28 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-28 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-28 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085 to the API
2026-03-28 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY06085>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'bce86a12-6770-5592-a386-5a5a62d50f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY06085',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 54764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_ea37e4675aa876e29a95b195b72c2af3.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_5d438164e180e9a78e6d1cbc6d34c203.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_21dba6f1886a299e39d88b5b55a8bcd6.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_3cc74fab30cc5cb0a8cd326b06dcb423.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_4b6a3fdbb6672f4900052c168fe7fcbf.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_8732b8c0547cea086a91098ec3959d43.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_67ea5c67f9ea335cbba83ee3d4efdce8.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_c6979175b953f608dbb32e7405cc98e7.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_fd05bfc1b1dd1f1f56f720ae8075cb44.jpg',
                'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_382fa60e7c58031fa94cb5f40c65990d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_ea37e4675aa876e29a95b195b72c2af3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_5d438164e180e9a78e6d1cbc6d34c203.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_21dba6f1886a299e39d88b5b55a8bcd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_3cc74fab30cc5cb0a8cd326b06dcb423.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2948031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_4b6a3fdbb6672f4900052c168fe7fcbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2871096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_8732b8c0547cea086a91098ec3959d43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_67ea5c67f9ea335cbba83ee3d4efdce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2850222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_c6979175b953f608dbb32e7405cc98e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_fd05bfc1b1dd1f1f56f720ae8075cb44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce86a12-6770-5592-a386-5a5a62d50f10/bce86a12-6770-5592-a386-5a5a62d50f10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/bc/e8bc403282ecb6d4d8cb5bd31510eb95/pa/TY06085_382fa60e7c58031fa94cb5f40c65990d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [auto1.de] INFO: Saving data for TY06085: {'created_time': 1774694142.275416, 'last_price_update_time': 1774694142.275431, 'auction_closing_time': 1774885459.0}
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY06085') HTTP/1.1" 204 0
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg not downloaded yet
2026-03-28 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd559d8050>
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg saved to cache
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_f3eceb59369dc162e471c063b0415a76.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_f3eceb59369dc162e471c063b0415a76.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_427fd15f32631316c3b3d522a6c732bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_427fd15f32631316c3b3d522a6c732bc.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_435b1ebbb46a22d452971674676e81d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_435b1ebbb46a22d452971674676e81d4.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_3c8a224e835da0008273b26f5c1aa282.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_3c8a224e835da0008273b26f5c1aa282.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_948c94262cab665b90cdea22801230a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_948c94262cab665b90cdea22801230a1.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_107a01cfe212bb9d998482e0de11f782.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_107a01cfe212bb9d998482e0de11f782.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg not downloaded yet
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_9bbffb59506ac8677b4006eab1b78888.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4a232869e972efa2eeae4639f6463282.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e922cd0>
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_9bbffb59506ac8677b4006eab1b78888.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_9bbffb59506ac8677b4006eab1b78888.jpg saved to cache
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN41763> (referer: https://www.auto1.com/v1/car-details-view/MN41763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA98041> (referer: https://www.auto1.com/v1/car-details-view/SA98041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU71027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaef490>
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_4a232869e972efa2eeae4639f6463282.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4a232869e972efa2eeae4639f6463282.jpg saved to cache
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f0ed0>
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg saved to cache
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-28 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 1
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_eee4b5a69607682e67427de3857eee5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_eee4b5a69607682e67427de3857eee5b.jpg not downloaded yet
2026-03-28 10:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-28 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 1
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_59057f237756f7740e6d2548aaf87cfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_59057f237756f7740e6d2548aaf87cfd.jpg not downloaded yet
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_e403e054f682a8b71dcf0bfe1005de54.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_e403e054f682a8b71dcf0bfe1005de54.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_66f64a2d6381565c45d8994aa03af854.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_66f64a2d6381565c45d8994aa03af854.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_b68d3216d83f3215b721b622f1cbed8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_b68d3216d83f3215b721b622f1cbed8c.jpg not downloaded yet
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_435b1ebbb46a22d452971674676e81d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_3c8a224e835da0008273b26f5c1aa282.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_7c787041aedf750e99ab78c355898713.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_7c787041aedf750e99ab78c355898713.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_adda3a7b7dc42be4e3a7119c742de575.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_adda3a7b7dc42be4e3a7119c742de575.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_ebaa09066e6f741d47504c018994f554.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ebaa09066e6f741d47504c018994f554.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg not downloaded yet
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e921590>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_435b1ebbb46a22d452971674676e81d4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_435b1ebbb46a22d452971674676e81d4.jpg saved to cache
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79dcd0>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_3c8a224e835da0008273b26f5c1aa282.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_3c8a224e835da0008273b26f5c1aa282.jpg saved to cache
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_459a12369cdb49492d9b27309432b46a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_459a12369cdb49492d9b27309432b46a.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_b3380983b93898539203088ab9c786dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b3380983b93898539203088ab9c786dc.jpg not downloaded yet
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg not downloaded yet
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_948c94262cab665b90cdea22801230a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_107a01cfe212bb9d998482e0de11f782.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_66f64a2d6381565c45d8994aa03af854.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_427fd15f32631316c3b3d522a6c732bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_b68d3216d83f3215b721b622f1cbed8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c4090>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_948c94262cab665b90cdea22801230a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_948c94262cab665b90cdea22801230a1.jpg saved to cache
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b5510>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_107a01cfe212bb9d998482e0de11f782.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_107a01cfe212bb9d998482e0de11f782.jpg saved to cache
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec11ed0>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_66f64a2d6381565c45d8994aa03af854.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_66f64a2d6381565c45d8994aa03af854.jpg saved to cache
2026-03-28 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd559d5b50>
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_427fd15f32631316c3b3d522a6c732bc.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_427fd15f32631316c3b3d522a6c732bc.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3ddd0>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_b68d3216d83f3215b721b622f1cbed8c.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_b68d3216d83f3215b721b622f1cbed8c.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME28341> (referer: https://www.auto1.com/v1/car-details-view/ME28341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2a290>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-28 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 1
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_3128583c4e81fec4471808b07b42e26e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_3128583c4e81fec4471808b07b42e26e.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg not downloaded yet
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b3380983b93898539203088ab9c786dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_04462ead9995b09a6b110e77628a4619.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_04462ead9995b09a6b110e77628a4619.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_d82cbb08e17da201070f5539b1165444.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d82cbb08e17da201070f5539b1165444.jpg not downloaded yet
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_167a60425a5f1307c260d936fcc55da8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_167a60425a5f1307c260d936fcc55da8.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_cb159becc82222a66cd64e9860af8f92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_cb159becc82222a66cd64e9860af8f92.jpg not downloaded yet
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_569d4aceb3d875dd748b047150e0065c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_569d4aceb3d875dd748b047150e0065c.jpg not downloaded yet
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_459a12369cdb49492d9b27309432b46a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea23590>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_b3380983b93898539203088ab9c786dc.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b3380983b93898539203088ab9c786dc.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_2b159ebffad534c12747ff510629abed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_2b159ebffad534c12747ff510629abed.jpg not downloaded yet
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b5010>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d82cbb08e17da201070f5539b1165444.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebce550>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_459a12369cdb49492d9b27309432b46a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_459a12369cdb49492d9b27309432b46a.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ebaa09066e6f741d47504c018994f554.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f8110>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg saved to cache
2026-03-28 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f677050>
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b3e90>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_d82cbb08e17da201070f5539b1165444.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d82cbb08e17da201070f5539b1165444.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_cb159becc82222a66cd64e9860af8f92.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_2b159ebffad534c12747ff510629abed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea0a550>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_ebaa09066e6f741d47504c018994f554.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ebaa09066e6f741d47504c018994f554.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f607350>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_cb159becc82222a66cd64e9860af8f92.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_cb159becc82222a66cd64e9860af8f92.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb8ad0>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_2b159ebffad534c12747ff510629abed.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_2b159ebffad534c12747ff510629abed.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_3128583c4e81fec4471808b07b42e26e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e6810>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_569d4aceb3d875dd748b047150e0065c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_167a60425a5f1307c260d936fcc55da8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e4fd0>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_3128583c4e81fec4471808b07b42e26e.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_3128583c4e81fec4471808b07b42e26e.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_04462ead9995b09a6b110e77628a4619.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG84960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebca8d0>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea72dd0>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_569d4aceb3d875dd748b047150e0065c.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_569d4aceb3d875dd748b047150e0065c.jpg saved to cache
2026-03-28 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b4f50>
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg saved to cache
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5b3c90>
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_167a60425a5f1307c260d936fcc55da8.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_167a60425a5f1307c260d936fcc55da8.jpg saved to cache
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c1d50>
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg saved to cache
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f777010>
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F8f%252F1c8f24a48e354a1e5dc4cdc0ca4e91fd%252Fpa%252FME28341_04462ead9995b09a6b110e77628a4619.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_04462ead9995b09a6b110e77628a4619.jpg saved to cache
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09db8b05-6129-57da-a056-0a494dafc844
2026-03-28 10:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09db8b05-6129-57da-a056-0a494dafc844, skipping ID generation
2026-03-28 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 1
2026-03-28 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09db8b05-6129-57da-a056-0a494dafc844 sending to next pipeline
2026-03-28 10:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09db8b05-6129-57da-a056-0a494dafc844, identifier: ME28341
2026-03-28 10:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-28 10:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-28 10:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341 to the API
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_04462ead9995b09a6b110e77628a4619.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': '09db8b05-6129-57da-a056-0a494dafc844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME28341',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 69902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_3128583c4e81fec4471808b07b42e26e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d8533f359d62fd9889d8ca3265a9b9f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_04462ead9995b09a6b110e77628a4619.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_d82cbb08e17da201070f5539b1165444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_167a60425a5f1307c260d936fcc55da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_f0cb9c7c79c8764d3361c16e24df0740.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3054634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_58e2fc57ff77518d05e0b7c8d0e7b2f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_cb159becc82222a66cd64e9860af8f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_569d4aceb3d875dd748b047150e0065c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09db8b05-6129-57da-a056-0a494dafc844/09db8b05-6129-57da-a056-0a494dafc844_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/8f/1c8f24a48e354a1e5dc4cdc0ca4e91fd/pa/ME28341_2b159ebffad534c12747ff510629abed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-28 10:35:47 [auto1.de] INFO: Saving data for ME28341: {'created_time': 1774694147.021136, 'last_price_update_time': 1774694147.021147, 'auction_closing_time': 1774884566.0}
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME28341') HTTP/1.1" 204 0
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU23342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_adda3a7b7dc42be4e3a7119c742de575.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_7c787041aedf750e99ab78c355898713.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f636b10>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_adda3a7b7dc42be4e3a7119c742de575.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_adda3a7b7dc42be4e3a7119c742de575.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e93d350>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c2d10>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea72610>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea556d0>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_7c787041aedf750e99ab78c355898713.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_7c787041aedf750e99ab78c355898713.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebba490>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea71d10>
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg saved to cache
2026-03-28 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_e403e054f682a8b71dcf0bfe1005de54.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea71cd0>
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_e403e054f682a8b71dcf0bfe1005de54.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_e403e054f682a8b71dcf0bfe1005de54.jpg saved to cache
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_eee4b5a69607682e67427de3857eee5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_59057f237756f7740e6d2548aaf87cfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_f3eceb59369dc162e471c063b0415a76.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1ca90>
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg saved to cache
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e50d0>
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg saved to cache
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_c82962e75d155073f3954845c43c4643.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS55924> (referer: https://www.auto1.com/v1/car-details-view/HS55924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb35210>
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F6e%252Fff6e746d3064e67b6c7fc592bb3cf45a%252Fpa%252FMN41763_eee4b5a69607682e67427de3857eee5b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_eee4b5a69607682e67427de3857eee5b.jpg saved to cache
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4
2026-03-28 10:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b46660f-5c9b-57a1-ad9b-998e17964bb4, skipping ID generation
2026-03-28 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 1
2026-03-28 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 sending to next pipeline
2026-03-28 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b46660f-5c9b-57a1-ad9b-998e17964bb4, identifier: MN41763
2026-03-28 10:35:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f564c90>
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fa2%252F33a22853489105bf4a23fd059300e862%252Fpa%252FSA98041_59057f237756f7740e6d2548aaf87cfd.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_59057f237756f7740e6d2548aaf87cfd.jpg saved to cache
2026-03-28 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99b12379-1f78-5394-801a-e102a6b1d01b
2026-03-28 10:35:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99b12379-1f78-5394-801a-e102a6b1d01b, skipping ID generation
2026-03-28 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 1
2026-03-28 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99b12379-1f78-5394-801a-e102a6b1d01b sending to next pipeline
2026-03-28 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99b12379-1f78-5394-801a-e102a6b1d01b, identifier: SA98041
2026-03-28 10:35:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab7450>
2026-03-28 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_f3eceb59369dc162e471c063b0415a76.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_f3eceb59369dc162e471c063b0415a76.jpg saved to cache
2026-03-28 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-28 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-28 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763 to the API
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_eee4b5a69607682e67427de3857eee5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'petrol',
 'id': '3b46660f-5c9b-57a1-ad9b-998e17964bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41763',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 38433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2163805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_eee4b5a69607682e67427de3857eee5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2252810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_e403e054f682a8b71dcf0bfe1005de54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_620ed852315cdbc0ad03b0de5a3384fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2136738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_66f64a2d6381565c45d8994aa03af854.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2219934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b5ba1d835df16ed758f81b03ce2125ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_7c787041aedf750e99ab78c355898713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_485a4e38cd7688a103b3a6592e17e8b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_3ae4dbca346ca3204682a1be81dfd7bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_459a12369cdb49492d9b27309432b46a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b46660f-5c9b-57a1-ad9b-998e17964bb4/3b46660f-5c9b-57a1-ad9b-998e17964bb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/6e/ff6e746d3064e67b6c7fc592bb3cf45a/pa/MN41763_b3380983b93898539203088ab9c786dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 250 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-28 10:35:49 [auto1.de] INFO: Saving data for MN41763: {'created_time': 1774694149.695584, 'last_price_update_time': 1774694149.695596, 'auction_closing_time': 1774883881.0}
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN41763') HTTP/1.1" 204 0
2026-03-28 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-28 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-28 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041 to the API
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_59057f237756f7740e6d2548aaf87cfd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:42Z',
 'fuel_type': 'diesel',
 'id': '99b12379-1f78-5394-801a-e102a6b1d01b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA98041',
 'listing': 'auction',
 'location': 'DE, Münster',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 228064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3151177,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_59057f237756f7740e6d2548aaf87cfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3111711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_f24c7bc3015aa712d11fc885d5967e9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_e87e2895a93e14ade928b76c40e4d5f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_b68d3216d83f3215b721b622f1cbed8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_346d9cba12dbbd5197b4fda9bb64355f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476946,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_adda3a7b7dc42be4e3a7119c742de575.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501685,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ebaa09066e6f741d47504c018994f554.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_3bfa8f1ca657e116e0330e7904fa4b47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_ab8c6d0b24a211f0d680394f582d5b3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99b12379-1f78-5394-801a-e102a6b1d01b/99b12379-1f78-5394-801a-e102a6b1d01b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/a2/33a22853489105bf4a23fd059300e862/pa/SA98041_71f8550b3f02f7bb5313f84a5cbdf08b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [auto1.de] INFO: Saving data for SA98041: {'created_time': 1774694150.105674, 'last_price_update_time': 1774694150.10569, 'auction_closing_time': 1774885422.0}
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA98041') HTTP/1.1" 204 0
2026-03-28 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55917210>
2026-03-28 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_c82962e75d155073f3954845c43c4643.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_c82962e75d155073f3954845c43c4643.jpg saved to cache
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-28 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e40d7a-1df2-509f-8967-6a59f4236ef9 with scrape type 1
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5e40d7a-1df2-509f-8967-6a59f4236ef9
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_0344f4baffd419e74353cc90767c81a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0344f4baffd419e74353cc90767c81a8.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_5ed3e93ec4984459cd68e8338bcf6719.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_5ed3e93ec4984459cd68e8338bcf6719.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_c34024b2374c799a2b6fc21db90f5481.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c34024b2374c799a2b6fc21db90f5481.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_c42abebb437296d621f1300d23d89f10.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c42abebb437296d621f1300d23d89f10.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_c044ffbbca99c84c53b85a23efbf1582.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c044ffbbca99c84c53b85a23efbf1582.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_68f790e263941e301515bbdf3855e6bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_68f790e263941e301515bbdf3855e6bc.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_7be40369120d0aa3f450a5b94c8710f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_7be40369120d0aa3f450a5b94c8710f3.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_0ccdcdd729e1932b75228146c80b38bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0ccdcdd729e1932b75228146c80b38bc.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_43401077d3e3038a19d85155a249c393.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_43401077d3e3038a19d85155a249c393.jpg already downloaded
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F46%252F3b4695b1d21bc918d2409e343427c12e%252Fpa%252FHS55924_b5996d0eb9cd067b2aaf9455923dda79.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_b5996d0eb9cd067b2aaf9455923dda79.jpg already downloaded
2026-03-28 10:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e40d7a-1df2-509f-8967-6a59f4236ef9, identifier: HS55924
2026-03-28 10:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-28 10:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-28 10:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924 to the API
2026-03-28 10:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS55924>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:23:17Z',
 'fuel_type': 'diesel',
 'id': 'f5e40d7a-1df2-509f-8967-6a59f4236ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55924',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0344f4baffd419e74353cc90767c81a8.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_5ed3e93ec4984459cd68e8338bcf6719.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c34024b2374c799a2b6fc21db90f5481.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c42abebb437296d621f1300d23d89f10.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c044ffbbca99c84c53b85a23efbf1582.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_68f790e263941e301515bbdf3855e6bc.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_7be40369120d0aa3f450a5b94c8710f3.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0ccdcdd729e1932b75228146c80b38bc.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_43401077d3e3038a19d85155a249c393.jpg',
                'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_b5996d0eb9cd067b2aaf9455923dda79.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0344f4baffd419e74353cc90767c81a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_5ed3e93ec4984459cd68e8338bcf6719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c34024b2374c799a2b6fc21db90f5481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c42abebb437296d621f1300d23d89f10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_c044ffbbca99c84c53b85a23efbf1582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_68f790e263941e301515bbdf3855e6bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_7be40369120d0aa3f450a5b94c8710f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_0ccdcdd729e1932b75228146c80b38bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_43401077d3e3038a19d85155a249c393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e40d7a-1df2-509f-8967-6a59f4236ef9/f5e40d7a-1df2-509f-8967-6a59f4236ef9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/46/3b4695b1d21bc918d2409e343427c12e/pa/HS55924_b5996d0eb9cd067b2aaf9455923dda79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-28 10:35:51 [auto1.de] INFO: Saving data for HS55924: {'created_time': 1774694151.662681, 'last_price_update_time': 1774694151.662694, 'auction_closing_time': 1774884197.0}
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55924') HTTP/1.1" 204 0
2026-03-28 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac2590>
2026-03-28 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4a%252F964a7185b93a94eb9f3ac1ee68de2001%252Fpa%252FZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg saved to cache
2026-03-28 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60
2026-03-28 10:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e8876c3-b03f-5eee-bed9-a39d915b9f60, skipping ID generation
2026-03-28 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 1
2026-03-28 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 sending to next pipeline
2026-03-28 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e8876c3-b03f-5eee-bed9-a39d915b9f60, identifier: ZV32018
2026-03-28 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-28 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-28 10:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018 to the API
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:39:43Z',
 'fuel_type': 'petrol',
 'id': '7e8876c3-b03f-5eee-bed9-a39d915b9f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV32018',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 112053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_c54f815bf3e6e0c0c587c9ced7e2f623.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_eddc35fb394793c75fa43c233c7b2bc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_26ffc3593963e71bb3f3b4079b8bf8b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_f3eceb59369dc162e471c063b0415a76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_427fd15f32631316c3b3d522a6c732bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_435b1ebbb46a22d452971674676e81d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_3c8a224e835da0008273b26f5c1aa282.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_948c94262cab665b90cdea22801230a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_107a01cfe212bb9d998482e0de11f782.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8876c3-b03f-5eee-bed9-a39d915b9f60/7e8876c3-b03f-5eee-bed9-a39d915b9f60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4a/964a7185b93a94eb9f3ac1ee68de2001/pa/ZV32018_5d612a177f7d0b7ffef94220bff75b78.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2013}
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-28 10:35:52 [auto1.de] INFO: Saving data for ZV32018: {'created_time': 1774694152.40019, 'last_price_update_time': 1774694152.4002, 'auction_closing_time': 1774885183.0}
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV32018') HTTP/1.1" 204 0
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_1994d84aec44343af256f4eb0155629a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b08b42ce294ea6cec86480e3c84e1319.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG84960> (referer: https://www.auto1.com/v1/car-details-view/MG84960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_675bbd828983055ce14c8a58e13109e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_7c9f19034f319bfd21913ad4c145e438.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_017725a0a044c703a27ea6ab54817b55.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL62048/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4ea50>
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_1994d84aec44343af256f4eb0155629a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_1994d84aec44343af256f4eb0155629a.jpg saved to cache
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac7d10>
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_b08b42ce294ea6cec86480e3c84e1319.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b08b42ce294ea6cec86480e3c84e1319.jpg saved to cache
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-28 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 1
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg not downloaded yet
2026-03-28 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d2690>
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_675bbd828983055ce14c8a58e13109e3.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_675bbd828983055ce14c8a58e13109e3.jpg saved to cache
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d1590>
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_7c9f19034f319bfd21913ad4c145e438.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_7c9f19034f319bfd21913ad4c145e438.jpg saved to cache
2026-03-28 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb10e50>
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_017725a0a044c703a27ea6ab54817b55.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_017725a0a044c703a27ea6ab54817b55.jpg saved to cache
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_76c564712b5313c36abb63896ded8ea4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN75028> (referer: https://www.auto1.com/v1/car-details-view/MN75028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_352079eb09b7224b4fc6f1c7cc155686.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_352079eb09b7224b4fc6f1c7cc155686.jpg not downloaded yet
2026-03-28 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg not downloaded yet
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_30355c740185b4f3152dff426d592eaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_30355c740185b4f3152dff426d592eaa.jpg not downloaded yet
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_53689faa158d0f76560fbfce9eeecbfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_53689faa158d0f76560fbfce9eeecbfd.jpg not downloaded yet
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8c681f0459d1bab4800b354014e01b39.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8c681f0459d1bab4800b354014e01b39.jpg not downloaded yet
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79d410>
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_76c564712b5313c36abb63896ded8ea4.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_76c564712b5313c36abb63896ded8ea4.jpg saved to cache
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_ae26b6479a1e113f9770796de7566252.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_ae26b6479a1e113f9770796de7566252.jpg not downloaded yet
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8eeefc2eb10032d1aba9d3612757e967.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8eeefc2eb10032d1aba9d3612757e967.jpg not downloaded yet
2026-03-28 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-28 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 1
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f720b635e4336094ce560c531475e70e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_aa420b664a5f4a9ecc2ff71589243793.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_aa420b664a5f4a9ecc2ff71589243793.jpg not downloaded yet
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79c710>
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg saved to cache
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_3347e72c74c785113eaef7b174a979a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_3347e72c74c785113eaef7b174a979a1.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_15b1b07683996ad125ca6a588844e89e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_15b1b07683996ad125ca6a588844e89e.jpg not downloaded yet
2026-03-28 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL93382> (referer: https://www.auto1.com/v1/car-details-view/HL93382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_8a801210dca8f3ffd4d687906c18f84e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_8a801210dca8f3ffd4d687906c18f84e.jpg not downloaded yet
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg not downloaded yet
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e921e10>
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg saved to cache
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_43d31c983c189df3ba1e25207acaca97.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_43d31c983c189df3ba1e25207acaca97.jpg not downloaded yet
2026-03-28 10:35:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5860d0>
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_f720b635e4336094ce560c531475e70e.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f720b635e4336094ce560c531475e70e.jpg saved to cache
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg not downloaded yet
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_3347e72c74c785113eaef7b174a979a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9626 | hits on page: 40
2026-03-28 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-28 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae973c76-46f9-5fa2-8d82-64faa3b77acd with scrape type 1
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae973c76-46f9-5fa2-8d82-64faa3b77acd
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_298781ce37ef8b066269739257182514.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_298781ce37ef8b066269739257182514.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_983d1d0b774587fe8284a3e7fe1b36d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_983d1d0b774587fe8284a3e7fe1b36d4.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_741fd27037718be5e0561f4e90440ccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_741fd27037718be5e0561f4e90440ccc.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_91912f7f4bb1170582c4927fe3a8fdc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_91912f7f4bb1170582c4927fe3a8fdc6.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_2677c574a47d9d6e9b71692924e074ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_2677c574a47d9d6e9b71692924e074ef.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_06ce4ff7a7b24c7a44cc17d7bea73a3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_06ce4ff7a7b24c7a44cc17d7bea73a3d.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_e696c3e1e166383e3beeab7ae493bca6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_e696c3e1e166383e3beeab7ae493bca6.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_6777fbb7e2ae549b58fb8ac101911634.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_6777fbb7e2ae549b58fb8ac101911634.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_c074fa2fd65d81f7292cb98ddf53421b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_c074fa2fd65d81f7292cb98ddf53421b.jpg already downloaded
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F5c%252F5a5c55f4e6a625299ea2d8dce90eeac5%252Fpa%252FHL93382_455abb845eb4a765a636c8f3eb824e48.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_455abb845eb4a765a636c8f3eb824e48.jpg already downloaded
2026-03-28 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae973c76-46f9-5fa2-8d82-64faa3b77acd, identifier: HL93382
2026-03-28 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_92845518fe28c90906099727b71ba49a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_92845518fe28c90906099727b71ba49a.jpg not downloaded yet
2026-03-28 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-28 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-28 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382 to the API
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL93382>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'petrol',
 'id': 'ae973c76-46f9-5fa2-8d82-64faa3b77acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL93382',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 32375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_298781ce37ef8b066269739257182514.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_983d1d0b774587fe8284a3e7fe1b36d4.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_741fd27037718be5e0561f4e90440ccc.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_91912f7f4bb1170582c4927fe3a8fdc6.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_2677c574a47d9d6e9b71692924e074ef.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_06ce4ff7a7b24c7a44cc17d7bea73a3d.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_e696c3e1e166383e3beeab7ae493bca6.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_6777fbb7e2ae549b58fb8ac101911634.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_c074fa2fd65d81f7292cb98ddf53421b.jpg',
                'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_455abb845eb4a765a636c8f3eb824e48.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_298781ce37ef8b066269739257182514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_983d1d0b774587fe8284a3e7fe1b36d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_741fd27037718be5e0561f4e90440ccc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974178,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_91912f7f4bb1170582c4927fe3a8fdc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_2677c574a47d9d6e9b71692924e074ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2434303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_06ce4ff7a7b24c7a44cc17d7bea73a3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_e696c3e1e166383e3beeab7ae493bca6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_6777fbb7e2ae549b58fb8ac101911634.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_c074fa2fd65d81f7292cb98ddf53421b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae973c76-46f9-5fa2-8d82-64faa3b77acd/ae973c76-46f9-5fa2-8d82-64faa3b77acd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/5c/5a5c55f4e6a625299ea2d8dce90eeac5/pa/HL93382_455abb845eb4a765a636c8f3eb824e48.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Saving data for HL93382: {'created_time': 1774694154.259702, 'last_price_update_time': 1774694154.259712, 'auction_closing_time': 1774884352.0}
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL93382') HTTP/1.1" 204 0
2026-03-28 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_aa420b664a5f4a9ecc2ff71589243793.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Scrape type for FT64289: 2
2026-03-28 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-28 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-28 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-28 10:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 133c4d7c-6612-550f-b57f-bdafea4b7b9a, identifier: FT64289
2026-03-28 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-28 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-28 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289 to the API
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:21:50Z',
 'fuel_type': 'diesel',
 'id': '133c4d7c-6612-550f-b57f-bdafea4b7b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 8,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-01',
 'seller_name': None,
 'title': 'Renault Master 2.0 BLUE dCi 3,5t L2H2 Advance',
 'transmission': 'manual',
 'trim': '3,5t L2H2 Advance',
 'year': 2025}
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Saving data for FT64289: {'auction_closing_time': 1774884110.0, 'created_time': 1773467046.002436, 'last_price_update_time': 1774694154.798213}
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64289') HTTP/1.1" 204 0
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Scrape type for KE10146: 1
2026-03-28 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU71027> (referer: https://www.auto1.com/v1/car-details-view/HU71027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU23342> (referer: https://www.auto1.com/v1/car-details-view/NU23342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea22f90>
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_3347e72c74c785113eaef7b174a979a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_3347e72c74c785113eaef7b174a979a1.jpg saved to cache
2026-03-28 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5870d0>
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg saved to cache
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for PN64243: 2
2026-03-28 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-28 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-28 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8bed2b0-5856-501f-b6bc-30ea04bf2272, identifier: PN64243
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92c590>
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_aa420b664a5f4a9ecc2ff71589243793.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_aa420b664a5f4a9ecc2ff71589243793.jpg saved to cache
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-28 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-28 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243 to the API
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': 'e8bed2b0-5856-501f-b6bc-30ea04bf2272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN64243',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 218792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-29',
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 Campus',
 'transmission': 'manual',
 'trim': 'Campus',
 'year': 2009}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Saving data for PN64243: {'auction_closing_time': 1774885284.0, 'created_time': 1774089097.285585, 'last_price_update_time': 1774694155.751856}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN64243') HTTP/1.1" 204 0
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for WH57282: 1
2026-03-28 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-28 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 1
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg not downloaded yet
2026-03-28 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-28 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 1
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_3cc38fa1db98267a5c9dde10891577ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_3cc38fa1db98267a5c9dde10891577ef.jpg not downloaded yet
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa0410>
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg saved to cache
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_92845518fe28c90906099727b71ba49a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for SE82228: 2
2026-03-28 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-28 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cc868c2-c105-5ea4-a934-cbac36b80516, identifier: SE82228
2026-03-28 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-28 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-28 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228 to the API
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:38:12Z',
 'fuel_type': 'diesel',
 'id': '5cc868c2-c105-5ea4-a934-cbac36b80516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE82228',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 65519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Saving data for SE82228: {'auction_closing_time': 1774885092.0, 'created_time': 1774349193.371459, 'last_price_update_time': 1774694156.373207}
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE82228') HTTP/1.1" 204 0
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg not downloaded yet
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg not downloaded yet
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for ZY49257: 2
2026-03-28 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-28 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8da9ac80-f1fa-5145-ac58-89a6e14d239a, identifier: ZY49257
2026-03-28 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-28 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-28 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257 to the API
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:47Z',
 'fuel_type': 'diesel',
 'id': '8da9ac80-f1fa-5145-ac58-89a6e14d239a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY49257',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 96249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H2 HKa 3,5 Komfort',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,5 Komfort',
 'year': 2021}
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Saving data for ZY49257: {'auction_closing_time': 1774883447.0, 'created_time': 1774264944.585885, 'last_price_update_time': 1774694156.999458}
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY49257') HTTP/1.1" 204 0
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_23252be31abe6f9b3517add2c7db7e13.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_23252be31abe6f9b3517add2c7db7e13.jpg not downloaded yet
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_f37b75481af4c4b645df5909d9128914.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f37b75481af4c4b645df5909d9128914.jpg not downloaded yet
2026-03-28 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_8a801210dca8f3ffd4d687906c18f84e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for PG18082: 1
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_07faaacaad681903027473efe9c05d95.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_07faaacaad681903027473efe9c05d95.jpg not downloaded yet
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg not downloaded yet
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebf35d0>
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg saved to cache
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaf7350>
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_92845518fe28c90906099727b71ba49a.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_92845518fe28c90906099727b71ba49a.jpg saved to cache
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_abff4d0d94f04d585b017268e8baf405.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for VX47645: 2
2026-03-28 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-28 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1, identifier: VX47645
2026-03-28 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-28 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-28 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645 to the API
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:43:20Z',
 'fuel_type': 'diesel',
 'id': '50b043e3-eff0-5c44-9e2d-b8220ee2e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX47645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 238616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'BMW 3er 335d GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Saving data for VX47645: {'auction_closing_time': 1774885400.0, 'created_time': 1773427825.237389, 'last_price_update_time': 1774694157.647428}
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX47645') HTTP/1.1" 204 0
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_c060f86eaf1394e30535af77c1664176.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_c060f86eaf1394e30535af77c1664176.jpg not downloaded yet
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_ddf3e1341ae38210ba4eb166331ca774.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_ddf3e1341ae38210ba4eb166331ca774.jpg not downloaded yet
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: GB42768
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for BV18863: 2
2026-03-28 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-28 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d09f1125-44f3-53de-baeb-61e66018ac27, identifier: BV18863
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd13d0>
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_8a801210dca8f3ffd4d687906c18f84e.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_8a801210dca8f3ffd4d687906c18f84e.jpg saved to cache
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-28 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-28 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863 to the API
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'diesel',
 'id': 'd09f1125-44f3-53de-baeb-61e66018ac27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV18863',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 248236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Saving data for BV18863: {'auction_closing_time': 1774883019.0, 'created_time': 1774032587.235567, 'last_price_update_time': 1774694158.208312}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV18863') HTTP/1.1" 204 0
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg not downloaded yet
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg not downloaded yet
2026-03-28 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f37b75481af4c4b645df5909d9128914.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Scrape type for HE38410: 1
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_c97e30407aae16c5bf10e66d65d155ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_c97e30407aae16c5bf10e66d65d155ed.jpg not downloaded yet
2026-03-28 10:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3e390>
2026-03-28 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_abff4d0d94f04d585b017268e8baf405.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_abff4d0d94f04d585b017268e8baf405.jpg saved to cache
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Scrape type for YC00182: 2
2026-03-28 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-28 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a388c19-a9d9-55c9-9ef8-b907272e4d33, identifier: YC00182
2026-03-28 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-28 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-28 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182 to the API
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 625,
 'expiration_date': '2026-03-30T15:25:06Z',
 'fuel_type': 'petrol',
 'id': '9a388c19-a9d9-55c9-9ef8-b907272e4d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC00182',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 137023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'BMW X5 M Competition',
 'transmission': 'automatic',
 'trim': 'BW   Competition',
 'year': 2020}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Saving data for YC00182: {'auction_closing_time': 1774884306.0, 'created_time': 1773898433.80827, 'last_price_update_time': 1774694158.856271}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC00182') HTTP/1.1" 204 0
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg not downloaded yet
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-28 10:35:59 [auto1.de] INFO: Scrape type for KZ11771: 2
2026-03-28 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-28 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-28 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 072680d4-0d47-5699-a1bb-d933ac3faae4, identifier: KZ11771
2026-03-28 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-28 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-28 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771 to the API
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:24Z',
 'fuel_type': 'diesel',
 'id': '072680d4-0d47-5699-a1bb-d933ac3faae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ11771',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 179346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-28 10:35:59 [auto1.de] INFO: Saving data for KZ11771: {'auction_closing_time': 1774885224.0, 'created_time': 1773469103.542024, 'last_price_update_time': 1774694159.451746}
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ11771') HTTP/1.1" 204 0
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg not downloaded yet
2026-03-28 10:35:59 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-28 10:35:59 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-28 10:35:59 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-28 10:35:59 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-28 10:35:59 [auto1.de] INFO: Scrape type for HJ16589: 2
2026-03-28 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-28 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-28 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d533f264-3c68-52e0-aefb-fee3a98eab18, identifier: HJ16589
2026-03-28 10:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e915b50>
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg saved to cache
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebd1390>
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_f37b75481af4c4b645df5909d9128914.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f37b75481af4c4b645df5909d9128914.jpg saved to cache
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecd5950>
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg') HTTP/1.1" 204 0
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg saved to cache
2026-03-28 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-28 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-28 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589 to the API
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'petrol',
 'id': 'd533f264-3c68-52e0-aefb-fee3a98eab18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ16589',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 66536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-24',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [auto1.de] INFO: Saving data for HJ16589: {'auction_closing_time': 1774885688.0, 'created_time': 1774118537.586079, 'last_price_update_time': 1774694160.245918}
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ16589') HTTP/1.1" 204 0
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_27f87675e6e5782ec1b315763d78cc1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_27f87675e6e5782ec1b315763d78cc1f.jpg not downloaded yet
2026-03-28 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:00 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-28 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL62048> (referer: https://www.auto1.com/v1/car-details-view/FL62048/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_43d31c983c189df3ba1e25207acaca97.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecc3850>
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg saved to cache
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-28 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 1
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3017df4-9d20-5512-8803-bf32bd7385e5
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_ea0b41c4db5163a87c049a792a1ff740.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_186537a16b334066debdb1211ef1baf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_fd981cb11445871b0f45ccb756a4f462.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_58171cf5828574efd37d7358a65e3f62.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg already downloaded
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F50%252F7650449bdc6c1871b4a2005c56e8f7b5%252Fpa%252FFL62048_6203e14a9050a99b696b89410226bf5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg already downloaded
2026-03-28 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3017df4-9d20-5512-8803-bf32bd7385e5, identifier: FL62048
2026-03-28 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f774190>
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_43d31c983c189df3ba1e25207acaca97.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_43d31c983c189df3ba1e25207acaca97.jpg saved to cache
2026-03-28 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-28 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-28 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048 to the API
2026-03-28 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL62048>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:36Z',
 'fuel_type': 'diesel',
 'id': 'c3017df4-9d20-5512-8803-bf32bd7385e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL62048',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg',
                'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_4a772d5b4bb5c438a6313dc6ad9f25b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_ea0b41c4db5163a87c049a792a1ff740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_186537a16b334066debdb1211ef1baf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d27708aefedae9c3fd96b3ab7fe383eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_fd981cb11445871b0f45ccb756a4f462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_2a1adca1dc715fdaf1d9061c3465ed76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_58171cf5828574efd37d7358a65e3f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_d6a3f0493eca73f8f07325c3f12121f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_bd1265e0f4ca5caf937f1e3fad2b8e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3017df4-9d20-5512-8803-bf32bd7385e5/c3017df4-9d20-5512-8803-bf32bd7385e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/50/7650449bdc6c1871b4a2005c56e8f7b5/pa/FL62048_6203e14a9050a99b696b89410226bf5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-28 10:36:01 [auto1.de] INFO: Saving data for FL62048: {'created_time': 1774694161.274836, 'last_price_update_time': 1774694161.27485, 'auction_closing_time': 1774884936.0}
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL62048') HTTP/1.1" 204 0
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_27f87675e6e5782ec1b315763d78cc1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e984250>
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg saved to cache
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_c97e30407aae16c5bf10e66d65d155ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f567750>
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_27f87675e6e5782ec1b315763d78cc1f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_27f87675e6e5782ec1b315763d78cc1f.jpg saved to cache
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:01 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9626 | hits on page: 40
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec2f010>
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg saved to cache
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb26710>
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg saved to cache
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-28 10:36:01 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-28 10:36:01 [auto1.de] INFO: Scrape type for KM53361: 2
2026-03-28 10:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-28 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-28 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-28 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125, identifier: KM53361
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_07faaacaad681903027473efe9c05d95.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-28 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-28 10:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361 to the API
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'petrol',
 'id': '66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM53361',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 108563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-28 10:36:02 [auto1.de] INFO: Saving data for KM53361: {'auction_closing_time': 1774885810.0, 'created_time': 1774032813.279066, 'last_price_update_time': 1774694162.047067}
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM53361') HTTP/1.1" 204 0
2026-03-28 10:36:02 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-28 10:36:02 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-28 10:36:02 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-28 10:36:02 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-28 10:36:02 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-28 10:36:02 [auto1.de] INFO: Scrape type for PU74458: 2
2026-03-28 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-28 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-28 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-28 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20c7fc49-a7c0-518c-984b-ffb89675dd3b, identifier: PU74458
2026-03-28 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_c060f86eaf1394e30535af77c1664176.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-28 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-28 10:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458 to the API
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': '20c7fc49-a7c0-518c-984b-ffb89675dd3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU74458',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 163279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2020}
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-28 10:36:02 [auto1.de] INFO: Saving data for PU74458: {'auction_closing_time': 1774885124.0, 'created_time': 1773467233.425054, 'last_price_update_time': 1774694162.941803}
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU74458') HTTP/1.1" 204 0
2026-03-28 10:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5d2590>
2026-03-28 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg saved to cache
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f566890>
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_c97e30407aae16c5bf10e66d65d155ed.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_c97e30407aae16c5bf10e66d65d155ed.jpg saved to cache
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for NK23311: 2
2026-03-28 10:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-28 10:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-28 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec, identifier: NK23311
2026-03-28 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-28 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-28 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311 to the API
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'diesel',
 'id': 'f0e70dff-d9ca-5752-a0ca-21a4efbb68ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23311',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 209235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Saving data for NK23311: {'auction_closing_time': 1774884155.0, 'created_time': 1773340532.785804, 'last_price_update_time': 1774694163.654293}
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK23311') HTTP/1.1" 204 0
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79e2d0>
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_07faaacaad681903027473efe9c05d95.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_07faaacaad681903027473efe9c05d95.jpg saved to cache
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f5950>
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg saved to cache
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for HP69948: 2
2026-03-28 10:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-28 10:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-28 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-28 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1d31c80-ff22-5695-b17a-80dea157cc43, identifier: HP69948
2026-03-28 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ69669> (referer: https://www.auto1.com/v1/car-details-view/TJ69669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-28 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-28 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948 to the API
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'petrol',
 'id': 'b1d31c80-ff22-5695-b17a-80dea157cc43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP69948',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 152439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Saving data for HP69948: {'auction_closing_time': 1774886122.0, 'created_time': 1774550009.091038, 'last_price_update_time': 1774694164.495468}
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP69948') HTTP/1.1" 204 0
2026-03-28 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4cdd0>
2026-03-28 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_c060f86eaf1394e30535af77c1664176.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_c060f86eaf1394e30535af77c1664176.jpg saved to cache
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Scrape type for YJ19312: 1
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Scrape type for NE48651: 1
2026-03-28 10:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-28 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 1
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_712a72bac64518765291f243a4618c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_712a72bac64518765291f243a4618c44.jpg not downloaded yet
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Scrape type for BA78869: 1
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg not downloaded yet
2026-03-28 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Scrape type for DJ78015: 1
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg not downloaded yet
2026-03-28 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:04 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [auto1.de] INFO: Scrape type for SM71650: 2
2026-03-28 10:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-28 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-28 10:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2bb0b73-1335-5937-87cb-e159b6fc6b70, identifier: SM71650
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg not downloaded yet
2026-03-28 10:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-28 10:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-28 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650 to the API
2026-03-28 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:53Z',
 'fuel_type': 'petrol',
 'id': 'c2bb0b73-1335-5937-87cb-e159b6fc6b70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM71650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 99464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [auto1.de] INFO: Saving data for SM71650: {'auction_closing_time': 1774883393.0, 'created_time': 1773467238.566988, 'last_price_update_time': 1774694165.209129}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM71650') HTTP/1.1" 204 0
2026-03-28 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_23252be31abe6f9b3517add2c7db7e13.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:05 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-28 10:36:05 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [auto1.de] INFO: Scrape type for ZU52934: 2
2026-03-28 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-28 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-28 10:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5eb92e6-1352-56b0-91aa-325a6ea0f107, identifier: ZU52934
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg not downloaded yet
2026-03-28 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_712a72bac64518765291f243a4618c44.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-28 10:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-28 10:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934 to the API
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:09:35Z',
 'fuel_type': 'diesel',
 'id': 'c5eb92e6-1352-56b0-91aa-325a6ea0f107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52934',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 293441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [auto1.de] INFO: Saving data for ZU52934: {'auction_closing_time': 1774883375.0, 'created_time': 1773427027.386419, 'last_price_update_time': 1774694165.823051}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU52934') HTTP/1.1" 204 0
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f566010>
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg saved to cache
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec11c90>
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg saved to cache
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd5563bf10>
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg saved to cache
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:06 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [auto1.de] INFO: Scrape type for PW89679: 2
2026-03-28 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-28 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-28 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31, identifier: PW89679
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_c185b22cf97feaa1c3539f50c72df931.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c185b22cf97feaa1c3539f50c72df931.jpg not downloaded yet
2026-03-28 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-28 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-28 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679 to the API
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:10Z',
 'fuel_type': 'petrol',
 'id': '29da9e3e-0669-5962-8ac1-a3bfcfb4cb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW89679',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 160628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-09',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI YES! Plus',
 'transmission': 'manual',
 'trim': 'YES! Plus',
 'year': 2017}
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [auto1.de] INFO: Saving data for PW89679: {'auction_closing_time': 1774884610.0, 'created_time': 1774349711.149055, 'last_price_update_time': 1774694166.533348}
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW89679') HTTP/1.1" 204 0
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb15410>
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F40%252F324027571146103293a29c305b246b31%252Fpa%252FHU71027_23252be31abe6f9b3517add2c7db7e13.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_23252be31abe6f9b3517add2c7db7e13.jpg saved to cache
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b13b881e-706a-5c25-9dd9-c4635d4fbfda
2026-03-28 10:36:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b13b881e-706a-5c25-9dd9-c4635d4fbfda, skipping ID generation
2026-03-28 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 1
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b13b881e-706a-5c25-9dd9-c4635d4fbfda sending to next pipeline
2026-03-28 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b13b881e-706a-5c25-9dd9-c4635d4fbfda, identifier: HU71027
2026-03-28 10:36:06 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [auto1.de] INFO: Scrape type for GD61279: 2
2026-03-28 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-28 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-28 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 869db8af-68c6-5fea-be14-893facef5e63, identifier: GD61279
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_b5a2acecd23d575c32ff3c536c381368.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b5a2acecd23d575c32ff3c536c381368.jpg not downloaded yet
2026-03-28 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-28 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-28 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027 to the API
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_23252be31abe6f9b3517add2c7db7e13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': 'b13b881e-706a-5c25-9dd9-c4635d4fbfda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU71027',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 144412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_4d8c7fadf678b7228ffe108b8fb30d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_f40c1a296b03b92f69cc546dcd33fb22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_23252be31abe6f9b3517add2c7db7e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_07faaacaad681903027473efe9c05d95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_c060f86eaf1394e30535af77c1664176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13b881e-706a-5c25-9dd9-c4635d4fbfda/b13b881e-706a-5c25-9dd9-c4635d4fbfda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/40/324027571146103293a29c305b246b31/pa/HU71027_573f850dd39d473a84d8c4c7d1fa34af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2006}
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [auto1.de] INFO: Saving data for HU71027: {'created_time': 1774694167.32364, 'last_price_update_time': 1774694167.323653, 'auction_closing_time': 1774886282.0}
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU71027') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-28 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-28 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279 to the API
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:01Z',
 'fuel_type': 'petrol',
 'id': '869db8af-68c6-5fea-be14-893facef5e63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61279',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 25398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [auto1.de] INFO: Saving data for GD61279: {'auction_closing_time': 1774886341.0, 'created_time': 1774032379.306741, 'last_price_update_time': 1774694167.705888}
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61279') HTTP/1.1" 204 0
2026-03-28 10:36:07 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 43 pages/min), scraped 134 items (at 44 items/min)
2026-03-28 10:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:36:07 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-28 10:36:07 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [auto1.de] INFO: Scrape type for KU32415: 2
2026-03-28 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-28 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-28 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03b29617-0326-54fd-be2c-fbb04bea1850, identifier: KU32415
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_1f2560bc891504d1873336119eb4ec47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f2560bc891504d1873336119eb4ec47.jpg not downloaded yet
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH57282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f584fd0>
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_712a72bac64518765291f243a4618c44.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_712a72bac64518765291f243a4618c44.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_ddf3e1341ae38210ba4eb166331ca774.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-28 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415 to the API
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:11:01Z',
 'fuel_type': 'diesel',
 'id': '03b29617-0326-54fd-be2c-fbb04bea1850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU32415',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 150093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 3.0 Td6 HSE LUXURY',
 'transmission': 'automatic',
 'trim': 'HSE LUXURY',
 'year': 2018}
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [auto1.de] INFO: Saving data for KU32415: {'auction_closing_time': 1774883461.0, 'created_time': 1774032362.913793, 'last_price_update_time': 1774694168.506318}
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU32415') HTTP/1.1" 204 0
2026-03-28 10:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:08 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-28 10:36:08 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [auto1.de] INFO: Scrape type for NG84191: 1
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg not downloaded yet
2026-03-28 10:36:08 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [auto1.de] INFO: Scrape type for UX99567: 2
2026-03-28 10:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-28 10:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-28 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a2a255-386b-5a9d-819e-981db8359b0b, identifier: UX99567
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg not downloaded yet
2026-03-28 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-28 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-28 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567 to the API
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:25:15Z',
 'fuel_type': 'petrol',
 'id': '43a2a255-386b-5a9d-819e-981db8359b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX99567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 164698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Saving data for UX99567: {'auction_closing_time': 1774884315.0, 'created_time': 1774349179.552114, 'last_price_update_time': 1774694169.177001}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX99567') HTTP/1.1" 204 0
2026-03-28 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f41d0>
2026-03-28 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_ddf3e1341ae38210ba4eb166331ca774.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_ddf3e1341ae38210ba4eb166331ca774.jpg saved to cache
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b5a2acecd23d575c32ff3c536c381368.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Scrape type for SR86923: 2
2026-03-28 10:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-28 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-28 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 067b3bf7-9c0e-549b-8d66-28ef27264a53, identifier: SR86923
2026-03-28 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f2560bc891504d1873336119eb4ec47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-28 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-28 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923 to the API
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:22:40Z',
 'fuel_type': 'petrol',
 'id': '067b3bf7-9c0e-549b-8d66-28ef27264a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR86923',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 132944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Saving data for SR86923: {'auction_closing_time': 1774884160.0, 'created_time': 1773426846.074432, 'last_price_update_time': 1774694169.863178}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR86923') HTTP/1.1" 204 0
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for ZX68256: 2
2026-03-28 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-28 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-28 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 148a4ffc-eed3-5dea-ac00-3894180a0b24, identifier: ZX68256
2026-03-28 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-28 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-28 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256 to the API
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:23:45Z',
 'fuel_type': 'diesel',
 'id': '148a4ffc-eed3-5dea-ac00-3894180a0b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX68256',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 237615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Saving data for ZX68256: {'auction_closing_time': 1774884225.0, 'created_time': 1774089046.74303, 'last_price_update_time': 1774694170.476638}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX68256') HTTP/1.1" 204 0
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ead8950>
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_b5a2acecd23d575c32ff3c536c381368.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b5a2acecd23d575c32ff3c536c381368.jpg saved to cache
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab4cd0>
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_1f2560bc891504d1873336119eb4ec47.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f2560bc891504d1873336119eb4ec47.jpg saved to cache
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_3cc38fa1db98267a5c9dde10891577ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1d810>
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe9765b604845ad3e0e2b55cd36c0d08%252Fpa%252FNU23342_3cc38fa1db98267a5c9dde10891577ef.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_3cc38fa1db98267a5c9dde10891577ef.jpg saved to cache
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8
2026-03-28 10:36:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8, skipping ID generation
2026-03-28 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 1
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 sending to next pipeline
2026-03-28 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8, identifier: NU23342
2026-03-28 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-28 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-28 10:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342 to the API
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_3cc38fa1db98267a5c9dde10891577ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:19:45Z',
 'fuel_type': 'petrol',
 'id': '97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23342',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 150914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_3cc38fa1db98267a5c9dde10891577ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_dfeff8d32f32e3894d1b4564055c4fd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f37b75481af4c4b645df5909d9128914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_1e5c1c3ad00cfebdf68253e8b26e571b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_ddf3e1341ae38210ba4eb166331ca774.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_61c9a7d6645e52ba2020b609d3fcc60c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_c97e30407aae16c5bf10e66d65d155ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_f1fa2257cf2ce0b095a9ac584a99022a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_9ecb77c913a10a24e6bdb52bb91a95cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8/97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be9765b604845ad3e0e2b55cd36c0d08/pa/NU23342_27f87675e6e5782ec1b315763d78cc1f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Saving data for NU23342: {'created_time': 1774694171.335417, 'last_price_update_time': 1774694171.335428, 'auction_closing_time': 1774883985.0}
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23342') HTTP/1.1" 204 0
2026-03-28 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9097d0>
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg saved to cache
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab71d0>
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg saved to cache
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1cf90>
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg saved to cache
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE38410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebba690>
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg saved to cache
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB20065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c185b22cf97feaa1c3539f50c72df931.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa0b90>
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg saved to cache
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb177d0>
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_c185b22cf97feaa1c3539f50c72df931.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c185b22cf97feaa1c3539f50c72df931.jpg saved to cache
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bff90>
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc95646e13f133c67af3ea3fd06ca03aa%252Fpa%252FTJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg saved to cache
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de9788a7-ace5-5900-a7e0-c3dd9f734d80
2026-03-28 10:36:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de9788a7-ace5-5900-a7e0-c3dd9f734d80, skipping ID generation
2026-03-28 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 1
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 sending to next pipeline
2026-03-28 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de9788a7-ace5-5900-a7e0-c3dd9f734d80, identifier: TJ69669
2026-03-28 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-28 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-28 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669 to the API
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 271,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '3.6L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:54:56Z',
 'fuel_type': 'petrol',
 'id': 'de9788a7-ace5-5900-a7e0-c3dd9f734d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ69669',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'BMW',
 'model': '7er',
 'odometer': 213913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_712a72bac64518765291f243a4618c44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_76378161bfbf8cc41282c59ae1ef875a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2749046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b63ae5b1f54cddc5c839b60f72546e70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_f4726ff5cb9881aa0f5eb4725f695156.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c683c9651d4c507f4606b24c47a6bb18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2781514,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_c185b22cf97feaa1c3539f50c72df931.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_b5a2acecd23d575c32ff3c536c381368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f2560bc891504d1873336119eb4ec47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_65df0f41b0106d44f997e25c1cd9f2cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9788a7-ace5-5900-a7e0-c3dd9f734d80/de9788a7-ace5-5900-a7e0-c3dd9f734d80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c95646e13f133c67af3ea3fd06ca03aa/pa/TJ69669_1f8c1ff6199e2d8699378c04cc7da301.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 735i L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2004}
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [auto1.de] INFO: Saving data for TJ69669: {'created_time': 1774694172.70101, 'last_price_update_time': 1774694172.701022, 'auction_closing_time': 1774886096.0}
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ69669') HTTP/1.1" 204 0
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ49235> (referer: https://www.auto1.com/v1/car-details-view/SJ49235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_15b1b07683996ad125ca6a588844e89e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-28 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 1
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_5f7435ae53096df5f8b285f22848fd34.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5f7435ae53096df5f8b285f22848fd34.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg not downloaded yet
2026-03-28 10:36:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec4be90>
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F2d%252Fb02d166336e9cdbabef9c94f27f0a75e%252Fpa%252FMN75028_15b1b07683996ad125ca6a588844e89e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_15b1b07683996ad125ca6a588844e89e.jpg saved to cache
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4
2026-03-28 10:36:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8580c2f3-7247-5588-abc8-9f5343fdb2e4, skipping ID generation
2026-03-28 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 1
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 sending to next pipeline
2026-03-28 10:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8580c2f3-7247-5588-abc8-9f5343fdb2e4, identifier: MN75028
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg not downloaded yet
2026-03-28 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-28 10:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-28 10:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028 to the API
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_15b1b07683996ad125ca6a588844e89e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:30Z',
 'fuel_type': 'diesel',
 'id': '8580c2f3-7247-5588-abc8-9f5343fdb2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN75028',
 'listing': 'auction',
 'location': 'DE, Neumünster',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 301680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_9b081f4a98f24a52d5f333cea84c9ae7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_da4f4f7f6ffe429a685d5dffd3593b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_aa420b664a5f4a9ecc2ff71589243793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_3347e72c74c785113eaef7b174a979a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_15b1b07683996ad125ca6a588844e89e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_8a801210dca8f3ffd4d687906c18f84e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_0aee928344b2b3bc730a5fb1f19f5b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_43d31c983c189df3ba1e25207acaca97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_f86a9af64ff3667cb4f0845856c0ac1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580c2f3-7247-5588-abc8-9f5343fdb2e4/8580c2f3-7247-5588-abc8-9f5343fdb2e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/2d/b02d166336e9cdbabef9c94f27f0a75e/pa/MN75028_92845518fe28c90906099727b71ba49a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Saving data for MN75028: {'created_time': 1774694173.488493, 'last_price_update_time': 1774694173.488505, 'auction_closing_time': 1774883250.0}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN75028') HTTP/1.1" 204 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg not downloaded yet
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_ae26b6479a1e113f9770796de7566252.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8eeefc2eb10032d1aba9d3612757e967.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa2d10>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_ae26b6479a1e113f9770796de7566252.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_ae26b6479a1e113f9770796de7566252.jpg saved to cache
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bcd10>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8eeefc2eb10032d1aba9d3612757e967.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8eeefc2eb10032d1aba9d3612757e967.jpg saved to cache
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56dc10>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5f7435ae53096df5f8b285f22848fd34.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eba68d0>
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7be7d0>
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea56a50>
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_5f7435ae53096df5f8b285f22848fd34.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5f7435ae53096df5f8b285f22848fd34.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f73d0>
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb4%252F6bb4653f5ded0d672b668ae4906b231e%252Fpa%252FSJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305
2026-03-28 10:36:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cdaa351-f824-5eb0-9ac3-0fbe71763305, skipping ID generation
2026-03-28 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 1
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 sending to next pipeline
2026-03-28 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaa351-f824-5eb0-9ac3-0fbe71763305, identifier: SJ49235
2026-03-28 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-28 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-28 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235 to the API
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:10:03Z',
 'fuel_type': 'petrol',
 'id': '5cdaa351-f824-5eb0-9ac3-0fbe71763305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ49235',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 151614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_ece46dbeb2c2ab0fd1e395f9a27004c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5f7435ae53096df5f8b285f22848fd34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_5a59e881a0a3f1f224594cd435db6edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_c70ddcd0edb09c9770cce23295a19ea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaa351-f824-5eb0-9ac3-0fbe71763305/5cdaa351-f824-5eb0-9ac3-0fbe71763305_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b4/6bb4653f5ded0d672b668ae4906b231e/pa/SJ49235_066a33ed2d4f04e35c9857f144ad3cfd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [auto1.de] INFO: Saving data for SJ49235: {'created_time': 1774694174.949756, 'last_price_update_time': 1774694174.949769, 'auction_closing_time': 1774883403.0}
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ49235') HTTP/1.1" 204 0
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ78015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_53689faa158d0f76560fbfce9eeecbfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8c681f0459d1bab4800b354014e01b39.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f4cd0>
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_53689faa158d0f76560fbfce9eeecbfd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_53689faa158d0f76560fbfce9eeecbfd.jpg saved to cache
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3f710>
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_8c681f0459d1bab4800b354014e01b39.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8c681f0459d1bab4800b354014e01b39.jpg saved to cache
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_30355c740185b4f3152dff426d592eaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f77af90>
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_30355c740185b4f3152dff426d592eaa.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_30355c740185b4f3152dff426d592eaa.jpg saved to cache
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_352079eb09b7224b4fc6f1c7cc155686.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa00d0>
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg saved to cache
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e987b50>
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b388ab291a6d7842d0f6fbe544fae2%252Fpa%252FMG84960_352079eb09b7224b4fc6f1c7cc155686.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_352079eb09b7224b4fc6f1c7cc155686.jpg saved to cache
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f
2026-03-28 10:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46b5d5e9-a987-5298-a878-bcf8433f2a7f, skipping ID generation
2026-03-28 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 1
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f sending to next pipeline
2026-03-28 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46b5d5e9-a987-5298-a878-bcf8433f2a7f, identifier: MG84960
2026-03-28 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-28 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-28 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960 to the API
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_352079eb09b7224b4fc6f1c7cc155686.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '46b5d5e9-a987-5298-a878-bcf8433f2a7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG84960',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 188478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7a7b714b6e5f853ed04c6d092f9dd9cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_7fdc22dfb74dd5d437bef7b6f7340f29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_352079eb09b7224b4fc6f1c7cc155686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2366938,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_1a66a80eafccaa6ce25d57b1418cd315.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_30355c740185b4f3152dff426d592eaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_53689faa158d0f76560fbfce9eeecbfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8a97fa8c394d971df5ce3fd78db1ee71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659635,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8c681f0459d1bab4800b354014e01b39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_ae26b6479a1e113f9770796de7566252.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b5d5e9-a987-5298-a878-bcf8433f2a7f/46b5d5e9-a987-5298-a878-bcf8433f2a7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815422,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b388ab291a6d7842d0f6fbe544fae2/pa/MG84960_8eeefc2eb10032d1aba9d3612757e967.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.6 SCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2019}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Saving data for MG84960: {'created_time': 1774694176.205294, 'last_price_update_time': 1774694176.205306, 'auction_closing_time': 1774882852.0}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG84960') HTTP/1.1" 204 0
2026-03-28 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE48651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb58f10>
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1c%252F1d1c599db50e1517b8a881886ef84e75%252Fpa%252FZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg saved to cache
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e
2026-03-28 10:36:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d0b9f5-b770-5530-a841-cc4d0b3d567e, skipping ID generation
2026-03-28 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 1
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e sending to next pipeline
2026-03-28 10:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6d0b9f5-b770-5530-a841-cc4d0b3d567e, identifier: ZF87196
2026-03-28 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-28 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-28 10:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196 to the API
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:27:30Z',
 'fuel_type': 'petrol',
 'id': 'd6d0b9f5-b770-5530-a841-cc4d0b3d567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF87196',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 170246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_e240439a62c2d15cead2079c65cc0ee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_7d375b7f3de0858ea959d100c4922bc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_675bbd828983055ce14c8a58e13109e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_9bbffb59506ac8677b4006eab1b78888.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2804059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_327bdc7fa292b290f4cf6b147380f22a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_846e86049eb5dfbe4b9fa4816575810c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_8d379068c23b1e9571e1c8fa77e1652a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_ef32475a70dd686af8e49e4f05d1f7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_c25ce519d120006a45683af089391fef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d0b9f5-b770-5530-a841-cc4d0b3d567e/d6d0b9f5-b770-5530-a841-cc4d0b3d567e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1c/1d1c599db50e1517b8a881886ef84e75/pa/ZF87196_dfbb7799db093e170a0e9128e6cf0af7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Saving data for ZF87196: {'created_time': 1774694176.87768, 'last_price_update_time': 1774694176.877691, 'auction_closing_time': 1774884450.0}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF87196') HTTP/1.1" 204 0
2026-03-28 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9722f211795dbffb51925b6b42c40a41.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea56210>
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_9722f211795dbffb51925b6b42c40a41.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9722f211795dbffb51925b6b42c40a41.jpg saved to cache
2026-03-28 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG84191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f7d90>
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg saved to cache
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH57282> (referer: https://www.auto1.com/v1/car-details-view/WH57282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-28 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 1
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_614d02b5acd453450b2e92222fa1818c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_614d02b5acd453450b2e92222fa1818c.jpg not downloaded yet
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_bf3dc131438e89e5a231db3611a86d55.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_bf3dc131438e89e5a231db3611a86d55.jpg not downloaded yet
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_497374c25b23154249d816af3f17886b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_497374c25b23154249d816af3f17886b.jpg not downloaded yet
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_f3a109f4e2001d2d4e437a06951dd720.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_f3a109f4e2001d2d4e437a06951dd720.jpg not downloaded yet
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_1376f04531af4ac3ea71148e38c31347.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_1376f04531af4ac3ea71148e38c31347.jpg not downloaded yet
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_16493acb4ab63a712c818a9f0338eff8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_1376f04531af4ac3ea71148e38c31347.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9870d0>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_16493acb4ab63a712c818a9f0338eff8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_16493acb4ab63a712c818a9f0338eff8.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_f3a109f4e2001d2d4e437a06951dd720.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3e350>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_1376f04531af4ac3ea71148e38c31347.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_1376f04531af4ac3ea71148e38c31347.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB04799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb9e90>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_f3a109f4e2001d2d4e437a06951dd720.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_f3a109f4e2001d2d4e437a06951dd720.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_497374c25b23154249d816af3f17886b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_614d02b5acd453450b2e92222fa1818c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb17c10>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_497374c25b23154249d816af3f17886b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_497374c25b23154249d816af3f17886b.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_bf3dc131438e89e5a231db3611a86d55.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f675450>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_614d02b5acd453450b2e92222fa1818c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_614d02b5acd453450b2e92222fa1818c.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e4f50>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F10%252F4d10ea7c80c920dfac84d0e330d38144%252Fpa%252FWH57282_bf3dc131438e89e5a231db3611a86d55.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_bf3dc131438e89e5a231db3611a86d55.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c6d5400-8ffa-525e-953f-58735e846c52
2026-03-28 10:36:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c6d5400-8ffa-525e-953f-58735e846c52, skipping ID generation
2026-03-28 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 1
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c6d5400-8ffa-525e-953f-58735e846c52 sending to next pipeline
2026-03-28 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c6d5400-8ffa-525e-953f-58735e846c52, identifier: WH57282
2026-03-28 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-28 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-28 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282 to the API
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_bf3dc131438e89e5a231db3611a86d55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:23:19Z',
 'fuel_type': 'petrol',
 'id': '9c6d5400-8ffa-525e-953f-58735e846c52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH57282',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 146602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_614d02b5acd453450b2e92222fa1818c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_bf3dc131438e89e5a231db3611a86d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_497374c25b23154249d816af3f17886b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_f3a109f4e2001d2d4e437a06951dd720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6d5400-8ffa-525e-953f-58735e846c52/9c6d5400-8ffa-525e-953f-58735e846c52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/10/4d10ea7c80c920dfac84d0e330d38144/pa/WH57282_1376f04531af4ac3ea71148e38c31347.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-28 10:36:23 [auto1.de] INFO: Saving data for WH57282: {'created_time': 1774694183.405419, 'last_price_update_time': 1774694183.405432, 'auction_closing_time': 1774884199.0}
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH57282') HTTP/1.1" 204 0
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea545d0>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f77a4d0>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_bfdfe490710e160394857c399fc4ebd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56f3d0>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_bfdfe490710e160394857c399fc4ebd7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_bfdfe490710e160394857c399fc4ebd7.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_82fab6ad88a7719e910d411efd56e0d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7e4610>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_82fab6ad88a7719e910d411efd56e0d9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_82fab6ad88a7719e910d411efd56e0d9.jpg saved to cache
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56c390>
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg saved to cache
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE38410> (referer: https://www.auto1.com/v1/car-details-view/HE38410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-28 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 1
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_397fd997989642f0007061c3f41e6103.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_397fd997989642f0007061c3f41e6103.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_217d496bd9953eacf47887f8c9fa0c85.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_217d496bd9953eacf47887f8c9fa0c85.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_d1af7624caf517ba01705adc572d39e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_d1af7624caf517ba01705adc572d39e7.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_662dbc34528b4975931bb9057477833f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_662dbc34528b4975931bb9057477833f.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_31b16604cc742e00f4e064b79bc6a25f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_31b16604cc742e00f4e064b79bc6a25f.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_2cd3e293376629589dea2d39f37b85ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_2cd3e293376629589dea2d39f37b85ac.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_820ab050e8ee02608072ae9c716914b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_820ab050e8ee02608072ae9c716914b3.jpg not downloaded yet
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_f90102a5e662a065b31000fee93c3b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_f90102a5e662a065b31000fee93c3b14.jpg not downloaded yet
2026-03-28 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb73410>
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F00%252Ff200ad16803ef6e8061642b12b415922%252Fpa%252FYM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg saved to cache
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 359cd182-fddc-5adb-907e-808bb578c25c
2026-03-28 10:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 359cd182-fddc-5adb-907e-808bb578c25c, skipping ID generation
2026-03-28 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 1
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 359cd182-fddc-5adb-907e-808bb578c25c sending to next pipeline
2026-03-28 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 359cd182-fddc-5adb-907e-808bb578c25c, identifier: YM01256
2026-03-28 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-28 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-28 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256 to the API
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'diesel',
 'id': '359cd182-fddc-5adb-907e-808bb578c25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM01256',
 'listing': 'auction',
 'location': 'DE, Seevetal',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 176943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_dbabc6b1c193aaccf9c7561c57aacffe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_58bbc42fc76d22c9c922290ae952325b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b5fd5692be0dfcd23cf74c7b1f461f35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_d20a027201dabf00af68e91048ae48a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a208c9a56c6f681e32d83208e4a7c6ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_a58b64293247d5343044f317efe6e7f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f720b635e4336094ce560c531475e70e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_b08b42ce294ea6cec86480e3c84e1319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_f07883f6abf9a53803ab5a9f3d1f45fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359cd182-fddc-5adb-907e-808bb578c25c/359cd182-fddc-5adb-907e-808bb578c25c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/00/f200ad16803ef6e8061642b12b415922/pa/YM01256_62557428d427bdd57aabaced82ff037f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D240 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2020}
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [auto1.de] INFO: Saving data for YM01256: {'created_time': 1774694185.415845, 'last_price_update_time': 1774694185.415856, 'auction_closing_time': 1774883625.0}
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM01256') HTTP/1.1" 204 0
2026-03-28 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_f90102a5e662a065b31000fee93c3b14.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb17550>
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_f90102a5e662a065b31000fee93c3b14.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_f90102a5e662a065b31000fee93c3b14.jpg saved to cache
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_820ab050e8ee02608072ae9c716914b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB20065> (referer: https://www.auto1.com/v1/car-details-view/FB20065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb71850>
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_820ab050e8ee02608072ae9c716914b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_820ab050e8ee02608072ae9c716914b3.jpg saved to cache
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e975c90>
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg saved to cache
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-28 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with scrape type 1
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_2708aa6ab8f8bdbf191c1014ea9463b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2708aa6ab8f8bdbf191c1014ea9463b1.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_5cb9b9144b6ebc7b09c032c61af49a69.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5cb9b9144b6ebc7b09c032c61af49a69.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_2c534beb86c7dd4bda06cebad3d3f3bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2c534beb86c7dd4bda06cebad3d3f3bb.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_468213f9faf57a683123749b44b26855.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_468213f9faf57a683123749b44b26855.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_68119bd03f544efbd4ecaa5da386b945.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_68119bd03f544efbd4ecaa5da386b945.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_cbf45f577f69e67d5d5b048d73e4f5ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_cbf45f577f69e67d5d5b048d73e4f5ab.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_b9a45a36368c2d06086f3ffd53ebfb7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_b9a45a36368c2d06086f3ffd53ebfb7d.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_d7300cd25cf89a60f3541f34a7557138.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_d7300cd25cf89a60f3541f34a7557138.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_83ac7a50eba1ab8d1cbcec422cb2e777.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_83ac7a50eba1ab8d1cbcec422cb2e777.jpg already downloaded
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F25%252F1f2528a61e28d86c8d2942a9c9a8adf8%252Fpa%252FFB20065_5450a8f2646a42c2580a9b39cb3039d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5450a8f2646a42c2580a9b39cb3039d1.jpg already downloaded
2026-03-28 10:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03, identifier: FB20065
2026-03-28 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-28 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-28 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065 to the API
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB20065>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:02Z',
 'fuel_type': 'petrol',
 'id': '1e3d2333-5cf7-59d3-a06a-3e38f583ca03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20065',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 58392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2708aa6ab8f8bdbf191c1014ea9463b1.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5cb9b9144b6ebc7b09c032c61af49a69.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2c534beb86c7dd4bda06cebad3d3f3bb.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_468213f9faf57a683123749b44b26855.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_68119bd03f544efbd4ecaa5da386b945.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_cbf45f577f69e67d5d5b048d73e4f5ab.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_b9a45a36368c2d06086f3ffd53ebfb7d.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_d7300cd25cf89a60f3541f34a7557138.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_83ac7a50eba1ab8d1cbcec422cb2e777.jpg',
                'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5450a8f2646a42c2580a9b39cb3039d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2708aa6ab8f8bdbf191c1014ea9463b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5cb9b9144b6ebc7b09c032c61af49a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_2c534beb86c7dd4bda06cebad3d3f3bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_468213f9faf57a683123749b44b26855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_68119bd03f544efbd4ecaa5da386b945.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_cbf45f577f69e67d5d5b048d73e4f5ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_b9a45a36368c2d06086f3ffd53ebfb7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_d7300cd25cf89a60f3541f34a7557138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_83ac7a50eba1ab8d1cbcec422cb2e777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3d2333-5cf7-59d3-a06a-3e38f583ca03/1e3d2333-5cf7-59d3-a06a-3e38f583ca03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/25/1f2528a61e28d86c8d2942a9c9a8adf8/pa/FB20065_5450a8f2646a42c2580a9b39cb3039d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Venga 1.6 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [auto1.de] INFO: Saving data for FB20065: {'created_time': 1774694186.507469, 'last_price_update_time': 1774694186.507479, 'auction_closing_time': 1774885262.0}
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB20065') HTTP/1.1" 204 0
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_2cd3e293376629589dea2d39f37b85ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa3050>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_2cd3e293376629589dea2d39f37b85ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_2cd3e293376629589dea2d39f37b85ac.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebb8550>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_662dbc34528b4975931bb9057477833f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_31b16604cc742e00f4e064b79bc6a25f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_d1af7624caf517ba01705adc572d39e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac5990>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_662dbc34528b4975931bb9057477833f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_662dbc34528b4975931bb9057477833f.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_397fd997989642f0007061c3f41e6103.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_217d496bd9953eacf47887f8c9fa0c85.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56ea50>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_31b16604cc742e00f4e064b79bc6a25f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_31b16604cc742e00f4e064b79bc6a25f.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7534d0>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_d1af7624caf517ba01705adc572d39e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_d1af7624caf517ba01705adc572d39e7.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1d750>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_397fd997989642f0007061c3f41e6103.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_397fd997989642f0007061c3f41e6103.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3f290>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F28%252F2c28c80e9057d8ced810a2e18c9dbe75%252Fpa%252FHE38410_217d496bd9953eacf47887f8c9fa0c85.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_217d496bd9953eacf47887f8c9fa0c85.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 287198ac-be94-5668-9861-a1b1a2c835af
2026-03-28 10:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 287198ac-be94-5668-9861-a1b1a2c835af, skipping ID generation
2026-03-28 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 1
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 287198ac-be94-5668-9861-a1b1a2c835af sending to next pipeline
2026-03-28 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 287198ac-be94-5668-9861-a1b1a2c835af, identifier: HE38410
2026-03-28 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-28 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-28 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410 to the API
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_217d496bd9953eacf47887f8c9fa0c85.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:12Z',
 'fuel_type': 'petrol',
 'id': '287198ac-be94-5668-9861-a1b1a2c835af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE38410',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 125595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_397fd997989642f0007061c3f41e6103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_217d496bd9953eacf47887f8c9fa0c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_d1af7624caf517ba01705adc572d39e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_662dbc34528b4975931bb9057477833f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_31b16604cc742e00f4e064b79bc6a25f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_28d371dab3e47d8e41aaabd7ac0e712d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_2cd3e293376629589dea2d39f37b85ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_a594af0d315e4bb7adbd23c5abd9ebe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_820ab050e8ee02608072ae9c716914b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_287198ac-be94-5668-9861-a1b1a2c835af/287198ac-be94-5668-9861-a1b1a2c835af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/28/2c28c80e9057d8ced810a2e18c9dbe75/pa/HE38410_f90102a5e662a065b31000fee93c3b14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [auto1.de] INFO: Saving data for HE38410: {'created_time': 1774694187.809622, 'last_price_update_time': 1774694187.809632, 'auction_closing_time': 1774885572.0}
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE38410') HTTP/1.1" 204 0
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_41adf98570717b033254b84eae0a558c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ78015> (referer: https://www.auto1.com/v1/car-details-view/DJ78015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_7c675df954c07071d26a4bb078a7850f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f6db250>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_41adf98570717b033254b84eae0a558c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_41adf98570717b033254b84eae0a558c.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-28 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 1
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg not downloaded yet
2026-03-28 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaecf90>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg saved to cache
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_2d0399716d1aa23237162b284abf77cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_2d0399716d1aa23237162b284abf77cb.jpg not downloaded yet
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg not downloaded yet
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f96d0>
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg saved to cache
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb26c90>
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F80%252F4280656551e5ff042556caa1351fe044%252Fpa%252FZY17523_7c675df954c07071d26a4bb078a7850f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_7c675df954c07071d26a4bb078a7850f.jpg saved to cache
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a718d79f-f2b7-5028-a2ad-de3486db6704
2026-03-28 10:36:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a718d79f-f2b7-5028-a2ad-de3486db6704, skipping ID generation
2026-03-28 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 1
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a718d79f-f2b7-5028-a2ad-de3486db6704 sending to next pipeline
2026-03-28 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a718d79f-f2b7-5028-a2ad-de3486db6704, identifier: ZY17523
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_e64b4c40032704132113ac67ed746d77.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_e64b4c40032704132113ac67ed746d77.jpg not downloaded yet
2026-03-28 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-28 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-28 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523 to the API
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_7c675df954c07071d26a4bb078a7850f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 269,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '3.6L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:05:09Z',
 'fuel_type': 'petrol',
 'id': 'a718d79f-f2b7-5028-a2ad-de3486db6704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY17523',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Porsche',
 'model': '911',
 'odometer': 180792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364240,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_72fc62450d79dfc7ef405eeb7c4081f3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337268,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_7c675df954c07071d26a4bb078a7850f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351176,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_39b69e7dcea521f41ffce2c15f07c1b4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52432,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9e4ba40c101358eb2ca6b256c5f473bf.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56842,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8ae9e5064a8aec4fd3fbaf2d3a013bb5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345996,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_9722f211795dbffb51925b6b42c40a41.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46575,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_76c564712b5313c36abb63896ded8ea4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56781,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_1994d84aec44343af256f4eb0155629a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332710,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_8996354c40645ef9ef9f61d5ef58e547.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a718d79f-f2b7-5028-a2ad-de3486db6704/a718d79f-f2b7-5028-a2ad-de3486db6704_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50531,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img42/80/4280656551e5ff042556caa1351fe044/pa/ZY17523_816e6264c6422f1cfdaea06d2d8f1f44.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche 911 996 Carrera',
 'transmission': 'manual',
 'trim': 'Carrera',
 'year': 2001}
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [auto1.de] INFO: Saving data for ZY17523: {'created_time': 1774694188.682929, 'last_price_update_time': 1774694188.682939, 'auction_closing_time': 1774883109.0}
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY17523') HTTP/1.1" 204 0
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_440a280775c98260d37cf38d8c4b500b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg not downloaded yet
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_befb67857ac49a1fe272cba269c30e88.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_befb67857ac49a1fe272cba269c30e88.jpg not downloaded yet
2026-03-28 10:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg not downloaded yet
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_3add68857531df16a48fecabe445d628.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_3add68857531df16a48fecabe445d628.jpg not downloaded yet
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_9004e862212749ccf4561a3a8f69e324.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_9004e862212749ccf4561a3a8f69e324.jpg not downloaded yet
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg not downloaded yet
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb14810>
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_440a280775c98260d37cf38d8c4b500b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_440a280775c98260d37cf38d8c4b500b.jpg saved to cache
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:28 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9628 | hits on page: 40
2026-03-28 10:36:28 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-28 10:36:28 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-28 10:36:28 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [auto1.de] INFO: Scrape type for CZ39134: 2
2026-03-28 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-28 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-28 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 528b345b-aec1-5f55-a634-2d0632c91f25, identifier: CZ39134
2026-03-28 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-28 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-28 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134 to the API
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:39Z',
 'fuel_type': 'diesel',
 'id': '528b345b-aec1-5f55-a634-2d0632c91f25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ39134',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 87938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Business Pack',
 'transmission': 'automatic',
 'trim': 'Business Pack',
 'year': 2012}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [auto1.de] INFO: Saving data for CZ39134: {'auction_closing_time': 1774884399.0, 'created_time': 1774350166.249739, 'last_price_update_time': 1774694189.384644}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ39134') HTTP/1.1" 204 0
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [auto1.de] INFO: Scrape type for EU15499: 2
2026-03-28 10:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-28 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-28 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4eb7213-36c4-5868-9c40-af4bbaaa996c, identifier: EU15499
2026-03-28 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-28 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-28 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499 to the API
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-30T15:12:58Z',
 'fuel_type': 'diesel',
 'id': 'f4eb7213-36c4-5868-9c40-af4bbaaa996c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU15499',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 108717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum 4WD',
 'year': 2021}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [auto1.de] INFO: Saving data for EU15499: {'auction_closing_time': 1774883578.0, 'created_time': 1774089317.9504, 'last_price_update_time': 1774694189.949712}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU15499') HTTP/1.1" 204 0
2026-03-28 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9bde50>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [auto1.de] INFO: Scrape type for HG48100: 2
2026-03-28 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-28 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-28 10:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39868fd1-b93c-58a8-a754-545dcc2c6020, identifier: HG48100
2026-03-28 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-28 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-28 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100 to the API
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:34Z',
 'fuel_type': 'petrol',
 'id': '39868fd1-b93c-58a8-a754-545dcc2c6020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG48100',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 106937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [auto1.de] INFO: Saving data for HG48100: {'auction_closing_time': 1774885234.0, 'created_time': 1774466689.460129, 'last_price_update_time': 1774694190.683116}
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG48100') HTTP/1.1" 204 0
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [auto1.de] INFO: Scrape type for WA68058: 1
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV73995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7f5190>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55cacbd0>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac3350>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_9004e862212749ccf4561a3a8f69e324.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-28 10:36:30 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [auto1.de] INFO: Scrape type for RZ05971: 2
2026-03-28 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-28 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-28 10:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba536df-8a11-5edd-9674-7308885b4298, identifier: RZ05971
2026-03-28 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-28 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-28 10:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971 to the API
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:58Z',
 'fuel_type': 'petrol',
 'id': 'cba536df-8a11-5edd-9674-7308885b4298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ05971',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 75673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2019}
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-28 10:36:31 [auto1.de] INFO: Saving data for RZ05971: {'auction_closing_time': 1774886278.0, 'created_time': 1773466726.012505, 'last_price_update_time': 1774694191.917327}
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ05971') HTTP/1.1" 204 0
2026-03-28 10:36:32 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-28 10:36:32 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [auto1.de] INFO: Scrape type for VL73605: 2
2026-03-28 10:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-28 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-28 10:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7456bbbf-6730-5685-a3a1-c8d69613b341, identifier: VL73605
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-28 10:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-28 10:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605 to the API
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'diesel',
 'id': '7456bbbf-6730-5685-a3a1-c8d69613b341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL73605',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 211789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [auto1.de] INFO: Saving data for VL73605: {'auction_closing_time': 1774883023.0, 'created_time': 1773340516.652333, 'last_price_update_time': 1774694192.513282}
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL73605') HTTP/1.1" 204 0
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f675d90>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_9004e862212749ccf4561a3a8f69e324.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_9004e862212749ccf4561a3a8f69e324.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:32 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [auto1.de] INFO: Scrape type for TZ58013: 2
2026-03-28 10:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-28 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-28 10:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ad947f-1293-59d3-b453-be4bb6e6c61c, identifier: TZ58013
2026-03-28 10:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-28 10:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-28 10:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013 to the API
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'petrol',
 'id': '97ad947f-1293-59d3-b453-be4bb6e6c61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ58013',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 48064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [auto1.de] INFO: Saving data for TZ58013: {'auction_closing_time': 1774883705.0, 'created_time': 1773426943.676638, 'last_price_update_time': 1774694193.077027}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ58013') HTTP/1.1" 204 0
2026-03-28 10:36:33 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-28 10:36:33 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-28 10:36:33 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [auto1.de] INFO: Scrape type for MG73872: 2
2026-03-28 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-28 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-28 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d88997-887b-52df-893c-fbc710dc53df, identifier: MG73872
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ19312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-28 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-28 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872 to the API
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:36Z',
 'fuel_type': 'diesel',
 'id': 'f8d88997-887b-52df-893c-fbc710dc53df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG73872',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [auto1.de] INFO: Saving data for MG73872: {'auction_closing_time': 1774884876.0, 'created_time': 1774118525.518917, 'last_price_update_time': 1774694193.564183}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG73872') HTTP/1.1" 204 0
2026-03-28 10:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:33 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-28 10:36:33 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [auto1.de] INFO: Scrape type for RM35826: 2
2026-03-28 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-28 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-28 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befa60f4-4c17-5a6a-b92f-9395611faa5f, identifier: RM35826
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eba7b10>
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg saved to cache
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-28 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-28 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826 to the API
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:08:22Z',
 'fuel_type': 'diesel',
 'id': 'befa60f4-4c17-5a6a-b92f-9395611faa5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM35826',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 208378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Saving data for RM35826: {'auction_closing_time': 1774883302.0, 'created_time': 1774034162.820759, 'last_price_update_time': 1774694194.106102}
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM35826') HTTP/1.1" 204 0
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Scrape type for EH57829: 1
2026-03-28 10:36:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9b4310>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Scrape type for GR42785: 2
2026-03-28 10:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-28 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-28 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc646d6b-7c20-506b-9143-884e56f2e2a8, identifier: GR42785
2026-03-28 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-28 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-28 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785 to the API
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': 'dc646d6b-7c20-506b-9143-884e56f2e2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR42785',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 150812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-09',
 'seller_name': None,
 'title': 'BMW 5er 520d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Saving data for GR42785: {'auction_closing_time': 1774884503.0, 'created_time': 1774032523.269895, 'last_price_update_time': 1774694194.793847}
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR42785') HTTP/1.1" 204 0
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_e64b4c40032704132113ac67ed746d77.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Scrape type for MM73538: 1
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_befb67857ac49a1fe272cba269c30e88.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE48651> (referer: https://www.auto1.com/v1/car-details-view/NE48651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-28 10:36:34 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [auto1.de] INFO: Scrape type for AH24505: 2
2026-03-28 10:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-28 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-28 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8421d342-f1a6-5edf-af7c-ef54e49bedc4, identifier: AH24505
2026-03-28 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-28 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-28 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505 to the API
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:33Z',
 'fuel_type': 'petrol',
 'id': '8421d342-f1a6-5edf-af7c-ef54e49bedc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH24505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 165755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-28 10:36:35 [auto1.de] INFO: Saving data for AH24505: {'auction_closing_time': 1774883433.0, 'created_time': 1774002232.691175, 'last_price_update_time': 1774694195.311546}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH24505') HTTP/1.1" 204 0
2026-03-28 10:36:35 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-28 10:36:35 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-28 10:36:35 [auto1.de] INFO: Scrape type for RF00811: 1
2026-03-28 10:36:35 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-28 10:36:35 [auto1.de] INFO: Scrape type for CA70430: 2
2026-03-28 10:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-28 10:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-28 10:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47645817-adc9-52c0-a905-ec71983c9669, identifier: CA70430
2026-03-28 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-28 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-28 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430 to the API
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:48Z',
 'fuel_type': 'diesel',
 'id': '47645817-adc9-52c0-a905-ec71983c9669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA70430',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 230367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-28 10:36:35 [auto1.de] INFO: Saving data for CA70430: {'auction_closing_time': 1774884288.0, 'created_time': 1773427209.387325, 'last_price_update_time': 1774694195.953275}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA70430') HTTP/1.1" 204 0
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec01d10>
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_e64b4c40032704132113ac67ed746d77.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_e64b4c40032704132113ac67ed746d77.jpg saved to cache
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa2610>
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_befb67857ac49a1fe272cba269c30e88.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_befb67857ac49a1fe272cba269c30e88.jpg saved to cache
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc with scrape type 1
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_22c8a16761ff1fa4d1448bca365a264f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_22c8a16761ff1fa4d1448bca365a264f.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_3db057d676bd4feaad1ebe65cad5922c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3db057d676bd4feaad1ebe65cad5922c.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_1854fa2db9420d30681c3dc643d388bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_1854fa2db9420d30681c3dc643d388bb.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_fafcc911f241c1dd215f8eaa45365df0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_fafcc911f241c1dd215f8eaa45365df0.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_4f0999eab957f3b175e835516bcac513.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_4f0999eab957f3b175e835516bcac513.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_b8bdce579dfb900126267acba638fff9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_b8bdce579dfb900126267acba638fff9.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_9b32a33f7b468013e8fecf60b85ddd5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_9b32a33f7b468013e8fecf60b85ddd5c.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_0b39c69fc9a4e67cc5174e4c4a375f5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_0b39c69fc9a4e67cc5174e4c4a375f5f.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_3f2b03bba0c58885d2519e4949a62910.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3f2b03bba0c58885d2519e4949a62910.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd2%252Fe6d2700c2a101fa6720c3d466b6f0ab3%252Fpa%252FNE48651_c0bfca0a1769113e4f79c3023818851b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_c0bfca0a1769113e4f79c3023818851b.jpg already downloaded
2026-03-28 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0eb8350f-f58c-5550-9d2f-01aafce80dcc, identifier: NE48651
2026-03-28 10:36:36 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-28 10:36:36 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [auto1.de] INFO: Scrape type for AZ56926: 2
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-28 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b77a11-6ac3-5fcc-b310-2d81855a4d86, identifier: AZ56926
2026-03-28 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-28 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-28 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651 to the API
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE48651>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:05:40Z',
 'fuel_type': 'diesel',
 'id': '0eb8350f-f58c-5550-9d2f-01aafce80dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE48651',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'BMW',
 'model': '3er',
 'odometer': 169912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_22c8a16761ff1fa4d1448bca365a264f.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3db057d676bd4feaad1ebe65cad5922c.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_1854fa2db9420d30681c3dc643d388bb.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_fafcc911f241c1dd215f8eaa45365df0.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_4f0999eab957f3b175e835516bcac513.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_b8bdce579dfb900126267acba638fff9.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_9b32a33f7b468013e8fecf60b85ddd5c.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_0b39c69fc9a4e67cc5174e4c4a375f5f.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3f2b03bba0c58885d2519e4949a62910.jpg',
                'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_c0bfca0a1769113e4f79c3023818851b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_22c8a16761ff1fa4d1448bca365a264f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3db057d676bd4feaad1ebe65cad5922c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_1854fa2db9420d30681c3dc643d388bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_fafcc911f241c1dd215f8eaa45365df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_4f0999eab957f3b175e835516bcac513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_b8bdce579dfb900126267acba638fff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_9b32a33f7b468013e8fecf60b85ddd5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_0b39c69fc9a4e67cc5174e4c4a375f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_3f2b03bba0c58885d2519e4949a62910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb8350f-f58c-5550-9d2f-01aafce80dcc/0eb8350f-f58c-5550-9d2f-01aafce80dcc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d2/e6d2700c2a101fa6720c3d466b6f0ab3/pa/NE48651_c0bfca0a1769113e4f79c3023818851b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [auto1.de] INFO: Saving data for NE48651: {'created_time': 1774694196.858969, 'last_price_update_time': 1774694196.858982, 'auction_closing_time': 1774883140.0}
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE48651') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-28 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-28 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926 to the API
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:23Z',
 'fuel_type': 'petrol',
 'id': '94b77a11-6ac3-5fcc-b310-2d81855a4d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ56926',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 105843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Saving data for AZ56926: {'auction_closing_time': 1774884863.0, 'created_time': 1774089480.171647, 'last_price_update_time': 1774694197.214863}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ56926') HTTP/1.1" 204 0
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE10146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Scrape type for GY33643: 2
2026-03-28 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-28 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-28 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d32802e-9aba-5601-81c5-9bd394276e39, identifier: GY33643
2026-03-28 10:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA78869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT95392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF51839> (referer: https://www.auto1.com/v1/car-details-view/HF51839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-28 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-28 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643 to the API
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-30T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '6d32802e-9aba-5601-81c5-9bd394276e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY33643',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 63837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 MPI Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2018}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Saving data for GY33643: {'auction_closing_time': 1774885734.0, 'created_time': 1774349161.132458, 'last_price_update_time': 1774694197.679535}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY33643') HTTP/1.1" 204 0
2026-03-28 10:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Scrape type for EK48004: 1
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 10:36:37 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-28 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-28 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 1
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_258c34ec418904fbc93bca08219ab53f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_258c34ec418904fbc93bca08219ab53f.jpg not downloaded yet
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_0ba9b939d325e3830bac2dafd3001c53.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_169671ade02f00fd0225c00b76570130.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_169671ade02f00fd0225c00b76570130.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_9c70f58661946fde1dfb99ec5cb03048.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9c70f58661946fde1dfb99ec5cb03048.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_6ae9993a2b22ce6f5c17114447646f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_6ae9993a2b22ce6f5c17114447646f16.jpg not downloaded yet
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg not downloaded yet
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_3add68857531df16a48fecabe445d628.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_2d0399716d1aa23237162b284abf77cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg not downloaded yet
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f587cd0>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_0ba9b939d325e3830bac2dafd3001c53.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_0ba9b939d325e3830bac2dafd3001c53.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_0f478d51d1976c43d6c4076577b0596a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_0f478d51d1976c43d6c4076577b0596a.jpg not downloaded yet
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB04799> (referer: https://www.auto1.com/v1/car-details-view/YB04799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca4810>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca59d0>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_3add68857531df16a48fecabe445d628.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_3add68857531df16a48fecabe445d628.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec11610>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_2d0399716d1aa23237162b284abf77cb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_2d0399716d1aa23237162b284abf77cb.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9c70f58661946fde1dfb99ec5cb03048.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-28 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with scrape type 1
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_930b72991fd355a484604b8311f97108.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_930b72991fd355a484604b8311f97108.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_36d4169b8fc75b04b72c877a94ad57e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_36d4169b8fc75b04b72c877a94ad57e7.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_f3ae71ad1b0f93795e9a80f95e97b83d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f3ae71ad1b0f93795e9a80f95e97b83d.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_deaf6aa62576b04084470887bd8efb21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_deaf6aa62576b04084470887bd8efb21.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_f9aa9c636858d7d1688b6224070d6749.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f9aa9c636858d7d1688b6224070d6749.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_90df71431ed4a22eb05908181294a0a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_90df71431ed4a22eb05908181294a0a2.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_c92ad69337863ffba33b89030fa66d28.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_c92ad69337863ffba33b89030fa66d28.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_bbc4ae21f8bb670cf5994e0e5a76ec68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_bbc4ae21f8bb670cf5994e0e5a76ec68.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_b8f6770c6e283423bea30a7053fe2616.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_b8f6770c6e283423bea30a7053fe2616.jpg already downloaded
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F83%252F7d839883a63a04a8a37cb02bc019452a%252Fpa%252FYB04799_df44a30f6ee8d1c3d2d1eb001fea80ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_df44a30f6ee8d1c3d2d1eb001fea80ec.jpg already downloaded
2026-03-28 10:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514, identifier: YB04799
2026-03-28 10:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-28 10:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-28 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799 to the API
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB04799>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:44Z',
 'fuel_type': 'petrol',
 'id': '6bfdcd9d-0e4d-545c-b615-fc40c3d53514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB04799',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 58474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_930b72991fd355a484604b8311f97108.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_36d4169b8fc75b04b72c877a94ad57e7.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f3ae71ad1b0f93795e9a80f95e97b83d.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_deaf6aa62576b04084470887bd8efb21.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f9aa9c636858d7d1688b6224070d6749.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_90df71431ed4a22eb05908181294a0a2.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_c92ad69337863ffba33b89030fa66d28.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_bbc4ae21f8bb670cf5994e0e5a76ec68.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_b8f6770c6e283423bea30a7053fe2616.jpg',
                'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_df44a30f6ee8d1c3d2d1eb001fea80ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317037,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_930b72991fd355a484604b8311f97108.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54000,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_36d4169b8fc75b04b72c877a94ad57e7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327559,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f3ae71ad1b0f93795e9a80f95e97b83d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279218,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_deaf6aa62576b04084470887bd8efb21.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310916,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_f9aa9c636858d7d1688b6224070d6749.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346214,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_90df71431ed4a22eb05908181294a0a2.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309701,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_c92ad69337863ffba33b89030fa66d28.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47102,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_bbc4ae21f8bb670cf5994e0e5a76ec68.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53486,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_b8f6770c6e283423bea30a7053fe2616.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bfdcd9d-0e4d-545c-b615-fc40c3d53514/6bfdcd9d-0e4d-545c-b615-fc40c3d53514_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308451,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/83/7d839883a63a04a8a37cb02bc019452a/pa/YB04799_df44a30f6ee8d1c3d2d1eb001fea80ec.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2012}
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [auto1.de] INFO: Saving data for YB04799: {'created_time': 1774694198.880254, 'last_price_update_time': 1774694198.880267, 'auction_closing_time': 1774885784.0}
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB04799') HTTP/1.1" 204 0
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb58e90>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_9c70f58661946fde1dfb99ec5cb03048.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9c70f58661946fde1dfb99ec5cb03048.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_6ae9993a2b22ce6f5c17114447646f16.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_0f478d51d1976c43d6c4076577b0596a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea29690>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F54%252F64548b1ecb4b9faafce7272c9144575f%252Fpa%252FDJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a6d22b5-1389-50e5-abed-e854a99960df
2026-03-28 10:36:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a6d22b5-1389-50e5-abed-e854a99960df, skipping ID generation
2026-03-28 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 1
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a6d22b5-1389-50e5-abed-e854a99960df sending to next pipeline
2026-03-28 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6d22b5-1389-50e5-abed-e854a99960df, identifier: DJ78015
2026-03-28 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-28 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-28 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015 to the API
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:02:17Z',
 'fuel_type': 'petrol',
 'id': '8a6d22b5-1389-50e5-abed-e854a99960df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ78015',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 9299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_64f82ffbc26c3af67b6fbc58a2b9fe9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_2d0399716d1aa23237162b284abf77cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_b76c4f7d215c70850c5b8f031c4475ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_e64b4c40032704132113ac67ed746d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_ce498c6b9431fe553cadda0fac2c1649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_befb67857ac49a1fe272cba269c30e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_6d463487004d3ed195ccb5f1c77069b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_3add68857531df16a48fecabe445d628.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_9004e862212749ccf4561a3a8f69e324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6d22b5-1389-50e5-abed-e854a99960df/8a6d22b5-1389-50e5-abed-e854a99960df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/54/64548b1ecb4b9faafce7272c9144575f/pa/DJ78015_c8fdb9f8e559f9618b0763ad2529d998.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [auto1.de] INFO: Saving data for DJ78015: {'created_time': 1774694199.829345, 'last_price_update_time': 1774694199.829357, 'auction_closing_time': 1774882937.0}
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ78015') HTTP/1.1" 204 0
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ19312> (referer: https://www.auto1.com/v1/car-details-view/YJ19312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f635ad0>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_6ae9993a2b22ce6f5c17114447646f16.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_6ae9993a2b22ce6f5c17114447646f16.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea3ac50>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55914450>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_0f478d51d1976c43d6c4076577b0596a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_0f478d51d1976c43d6c4076577b0596a.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea3b850>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-28 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77508fb4-e836-5715-98ca-619c10a5c23d with scrape type 1
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_64d13f5ffaccbe390ecc994783b730da.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_64d13f5ffaccbe390ecc994783b730da.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_e64431991ada31d417cb5fbab4286b70.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_e64431991ada31d417cb5fbab4286b70.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_32aaaf0f9d10660512594181148240c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_32aaaf0f9d10660512594181148240c4.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg not downloaded yet
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg not downloaded yet
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_169671ade02f00fd0225c00b76570130.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55786910>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_169671ade02f00fd0225c00b76570130.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_169671ade02f00fd0225c00b76570130.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_258c34ec418904fbc93bca08219ab53f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92fa10>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f753910>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f572510>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_32aaaf0f9d10660512594181148240c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_e64431991ada31d417cb5fbab4286b70.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f8c50>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F0c%252Fd70c2a18f220abbf42ed5f4b1f355775%252Fpa%252FHF51839_258c34ec418904fbc93bca08219ab53f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_258c34ec418904fbc93bca08219ab53f.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2652391c-004d-567a-a177-39b2dc05ed5d
2026-03-28 10:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2652391c-004d-567a-a177-39b2dc05ed5d, skipping ID generation
2026-03-28 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 1
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2652391c-004d-567a-a177-39b2dc05ed5d sending to next pipeline
2026-03-28 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2652391c-004d-567a-a177-39b2dc05ed5d, identifier: HF51839
2026-03-28 10:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-28 10:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-28 10:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839 to the API
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_258c34ec418904fbc93bca08219ab53f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '2652391c-004d-567a-a177-39b2dc05ed5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF51839',
 'listing': 'auction',
 'location': 'DE, Montabaur',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 157865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_541d0c16e87a8e55a1e54b1e3fa3950b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_258c34ec418904fbc93bca08219ab53f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_ad74ee25db0abd05ecf117c4c97c166a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_8cc4ede54314a7df3e83d505fb1a38eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_169671ade02f00fd0225c00b76570130.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9c70f58661946fde1dfb99ec5cb03048.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_6ae9993a2b22ce6f5c17114447646f16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3029407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_c44f9ab54249aaf4877a84938fdcf3b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_9ea8bd1257baec99641fcf7bf66e52f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2652391c-004d-567a-a177-39b2dc05ed5d/2652391c-004d-567a-a177-39b2dc05ed5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3035811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/0c/d70c2a18f220abbf42ed5f4b1f355775/pa/HF51839_0f478d51d1976c43d6c4076577b0596a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-28 10:36:41 [auto1.de] INFO: Saving data for HF51839: {'created_time': 1774694201.465885, 'last_price_update_time': 1774694201.465896, 'auction_closing_time': 1774884897.0}
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF51839') HTTP/1.1" 204 0
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_64d13f5ffaccbe390ecc994783b730da.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA68058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG18082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3c990>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f620050>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_32aaaf0f9d10660512594181148240c4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_32aaaf0f9d10660512594181148240c4.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f9590>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_e64431991ada31d417cb5fbab4286b70.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_e64431991ada31d417cb5fbab4286b70.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1b0d0>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_64d13f5ffaccbe390ecc994783b730da.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_64d13f5ffaccbe390ecc994783b730da.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e903a50>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_a888b0f247496eec3312bd7ac870790d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f621150>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f605490>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec01290>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:42 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9629 | hits on page: 40
2026-03-28 10:36:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea10790>
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F75%252Ff4754692edea01ab08229184e5d01598%252Fpa%252FYJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77508fb4-e836-5715-98ca-619c10a5c23d
2026-03-28 10:36:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77508fb4-e836-5715-98ca-619c10a5c23d, skipping ID generation
2026-03-28 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77508fb4-e836-5715-98ca-619c10a5c23d with scrape type 1
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77508fb4-e836-5715-98ca-619c10a5c23d sending to next pipeline
2026-03-28 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77508fb4-e836-5715-98ca-619c10a5c23d, identifier: YJ19312
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea193d0>
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ffc%252F30fc6c488dcf1ba96398c2e7bb5d82f9%252Fpa%252FUD07606_a888b0f247496eec3312bd7ac870790d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_a888b0f247496eec3312bd7ac870790d.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38b7e8ae-d276-5575-917e-51d2cd665d74
2026-03-28 10:36:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38b7e8ae-d276-5575-917e-51d2cd665d74, skipping ID generation
2026-03-28 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b7e8ae-d276-5575-917e-51d2cd665d74 with scrape type 1
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38b7e8ae-d276-5575-917e-51d2cd665d74 sending to next pipeline
2026-03-28 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b7e8ae-d276-5575-917e-51d2cd665d74, identifier: UD07606
2026-03-28 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-28 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-28 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312 to the API
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:15:40Z',
 'fuel_type': 'diesel',
 'id': '77508fb4-e836-5715-98ca-619c10a5c23d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19312',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 141082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64803,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_35f1abdd0184e296678ecf4aa88543cf.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324332,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_7cd8f38fda59e8160bfebcaab7c90edc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307560,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_db7a603c7a5ab02e6cffbcaafe7cb7db.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42973,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_64d13f5ffaccbe390ecc994783b730da.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50057,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_6b5db77222d263efa8c3cdcd3b7919d4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299124,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_cb0deefdf95918fea5c2aa79799dd9ec.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41694,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_e64431991ada31d417cb5fbab4286b70.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273037,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_32aaaf0f9d10660512594181148240c4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339973,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_59c94e394141d5505bd77cfd2625e2b8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77508fb4-e836-5715-98ca-619c10a5c23d/77508fb4-e836-5715-98ca-619c10a5c23d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343827,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/75/f4754692edea01ab08229184e5d01598/pa/YJ19312_54de9b6ab447db3b59d054cf4e7fdf4c.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2018}
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-28 10:36:42 [auto1.de] INFO: Saving data for YJ19312: {'created_time': 1774694202.756457, 'last_price_update_time': 1774694202.756469, 'auction_closing_time': 1774883740.0}
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ19312') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b7e8ae-d276-5575-917e-51d2cd665d74 with identifier: UD07606
2026-03-28 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b7e8ae-d276-5575-917e-51d2cd665d74 with identifier: UD07606
2026-03-28 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b7e8ae-d276-5575-917e-51d2cd665d74 with identifier: UD07606 to the API
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_a888b0f247496eec3312bd7ac870790d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:48:20Z',
 'fuel_type': 'petrol',
 'id': '38b7e8ae-d276-5575-917e-51d2cd665d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD07606',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 127451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_a888b0f247496eec3312bd7ac870790d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_440a280775c98260d37cf38d8c4b500b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_2042c7b82c81f7ad79e1816b3459e5cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_5a3989aa90e0cc71366e87729c3e287d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_82fab6ad88a7719e910d411efd56e0d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_16493acb4ab63a712c818a9f0338eff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_abff4d0d94f04d585b017268e8baf405.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_017725a0a044c703a27ea6ab54817b55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_c82962e75d155073f3954845c43c4643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b7e8ae-d276-5575-917e-51d2cd665d74/38b7e8ae-d276-5575-917e-51d2cd665d74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/fc/30fc6c488dcf1ba96398c2e7bb5d82f9/pa/UD07606_b60750fe8f82262c8e59adf6985e1fb6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD07606%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Saving data for UD07606: {'created_time': 1774694203.203408, 'last_price_update_time': 1774694203.203424, 'auction_closing_time': 1774885700.0}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD07606') HTTP/1.1" 204 0
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_67f46bee3b1e518308233fa9fa3af796.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF00811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM73538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG84191> (referer: https://www.auto1.com/v1/car-details-view/NG84191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL77757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ead9150>
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F38%252Fe1383fa8b35ce6a198aaac2ea00a2c35%252Fpa%252FHR22131_67f46bee3b1e518308233fa9fa3af796.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_67f46bee3b1e518308233fa9fa3af796.jpg saved to cache
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053
2026-03-28 10:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053, skipping ID generation
2026-03-28 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 1
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 sending to next pipeline
2026-03-28 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053, identifier: HR22131
2026-03-28 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-28 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-28 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131 to the API
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_67f46bee3b1e518308233fa9fa3af796.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '4c8e8731-4edb-5ec2-8286-1d6a4e1c9053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR22131',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 178361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_67f46bee3b1e518308233fa9fa3af796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_0ba9b939d325e3830bac2dafd3001c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a4a6050dbb686ad2f3732b606b4ee736.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_4feede12169dbb606d797bccd53fb132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_a77e913bdaa8c71c08a195d31d6f8038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8e8731-4edb-5ec2-8286-1d6a4e1c9053/4c8e8731-4edb-5ec2-8286-1d6a4e1c9053_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/38/e1383fa8b35ce6a198aaac2ea00a2c35/pa/HR22131_abaaf3d0961c797c8aeacfecf0c11b11.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [auto1.de] INFO: Saving data for HR22131: {'created_time': 1774694204.171055, 'last_price_update_time': 1774694204.171072, 'auction_closing_time': 1774886304.0}
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR22131') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-28 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 1
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_92d509ccf5d0c896aedf03c4b8014854.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_92d509ccf5d0c896aedf03c4b8014854.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg not downloaded yet
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg not downloaded yet
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ba0786cb2a733c0c538f6058f21dc159.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_5e76abac231bb03734c0b14cc14e563f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_5e76abac231bb03734c0b14cc14e563f.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_01e0b565c35a69f6696f5d947da280de.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_01e0b565c35a69f6696f5d947da280de.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_9d877b57a06c1a50510dccee07c07dd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_9d877b57a06c1a50510dccee07c07dd7.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_8cb4712eafc14dc1a58d27364a000692.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_8cb4712eafc14dc1a58d27364a000692.jpg not downloaded yet
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_89c8405e36b7728ae9a174c2c808820f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_89c8405e36b7728ae9a174c2c808820f.jpg not downloaded yet
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55c80650>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_a40d6e33b37a676e321273d060724f46.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_a40d6e33b37a676e321273d060724f46.jpg not downloaded yet
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f789090>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_ba0786cb2a733c0c538f6058f21dc159.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ba0786cb2a733c0c538f6058f21dc159.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_d414a4206007b91a36ef579456ba59ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55915050>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:36:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb59a90>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F6e%252Ffc6ebac75b8c119f50119d41fcd1fd33%252Fpa%252FJV93942_d414a4206007b91a36ef579456ba59ca.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_d414a4206007b91a36ef579456ba59ca.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3
2026-03-28 10:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3, skipping ID generation
2026-03-28 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 1
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 sending to next pipeline
2026-03-28 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3, identifier: JV93942
2026-03-28 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-28 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-28 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942 to the API
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_d414a4206007b91a36ef579456ba59ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:08Z',
 'fuel_type': 'petrol',
 'id': '9398a5d0-2ff1-589f-95af-e3891ec6f6d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV93942',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 50050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_d414a4206007b91a36ef579456ba59ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3f09ba024bf7d53dc583991b1ef9ef58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_41adf98570717b033254b84eae0a558c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_92181527449fef6a83ea092635089af6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_bfdfe490710e160394857c399fc4ebd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_3869b70d37cd9f35a0d403e6dc52eeb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_44c27f97a8f5e91121664b201ed5ba2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3113045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_7c9f19034f319bfd21913ad4c145e438.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2828034,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4a232869e972efa2eeae4639f6463282.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9398a5d0-2ff1-589f-95af-e3891ec6f6d3/9398a5d0-2ff1-589f-95af-e3891ec6f6d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/6e/fc6ebac75b8c119f50119d41fcd1fd33/pa/JV93942_4b77a43e4bd2fba92ea622b104dce399.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Saving data for JV93942: {'created_time': 1774694205.414746, 'last_price_update_time': 1774694205.414755, 'auction_closing_time': 1774885268.0}
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV93942') HTTP/1.1" 204 0
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_89c8405e36b7728ae9a174c2c808820f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_a40d6e33b37a676e321273d060724f46.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH57829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK48004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd559da210>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3c190>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac5cd0>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_89c8405e36b7728ae9a174c2c808820f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_89c8405e36b7728ae9a174c2c808820f.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3d990>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_a40d6e33b37a676e321273d060724f46.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_a40d6e33b37a676e321273d060724f46.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_8cb4712eafc14dc1a58d27364a000692.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_9d877b57a06c1a50510dccee07c07dd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_5e76abac231bb03734c0b14cc14e563f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_01e0b565c35a69f6696f5d947da280de.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaf4950>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf6b50>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_8cb4712eafc14dc1a58d27364a000692.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_8cb4712eafc14dc1a58d27364a000692.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55914bd0>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_9d877b57a06c1a50510dccee07c07dd7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_9d877b57a06c1a50510dccee07c07dd7.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4d790>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_5e76abac231bb03734c0b14cc14e563f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_5e76abac231bb03734c0b14cc14e563f.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea54d90>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_01e0b565c35a69f6696f5d947da280de.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_01e0b565c35a69f6696f5d947da280de.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV73995> (referer: https://www.auto1.com/v1/car-details-view/YV73995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-28 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 1
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_98910f953d557e1cf7ed5efb544e059f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_98910f953d557e1cf7ed5efb544e059f.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg not downloaded yet
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_80dc5d529d100c8ef70a39f0636c5525.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_80dc5d529d100c8ef70a39f0636c5525.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg not downloaded yet
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg not downloaded yet
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_92d509ccf5d0c896aedf03c4b8014854.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4cd10>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg saved to cache
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca4ed0>
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fbf%252F95bf7373d3b94cd1a93411c5b647905b%252Fpa%252FNG84191_92d509ccf5d0c896aedf03c4b8014854.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_92d509ccf5d0c896aedf03c4b8014854.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a
2026-03-28 10:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a, skipping ID generation
2026-03-28 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 1
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a sending to next pipeline
2026-03-28 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a, identifier: NG84191
2026-03-28 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-28 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-28 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191 to the API
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_92d509ccf5d0c896aedf03c4b8014854.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:50:19Z',
 'fuel_type': 'diesel',
 'id': '82a698c1-2f25-5677-a8ae-3ea1784e3a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG84191',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 159110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_92d509ccf5d0c896aedf03c4b8014854.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_30f257599b90e24bd48c5bac9e0c90b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_1892a785a6cbfe1604b9a2d9eb598867.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_00a9fa9712399fffbcfda1e1a03121b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_5e76abac231bb03734c0b14cc14e563f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_01e0b565c35a69f6696f5d947da280de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_9d877b57a06c1a50510dccee07c07dd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866392,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_8cb4712eafc14dc1a58d27364a000692.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_89c8405e36b7728ae9a174c2c808820f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a698c1-2f25-5677-a8ae-3ea1784e3a0a/82a698c1-2f25-5677-a8ae-3ea1784e3a0a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/bf/95bf7373d3b94cd1a93411c5b647905b/pa/NG84191_a40d6e33b37a676e321273d060724f46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-28 10:36:47 [auto1.de] INFO: Saving data for NG84191: {'created_time': 1774694207.684197, 'last_price_update_time': 1774694207.684208, 'auction_closing_time': 1774885819.0}
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG84191') HTTP/1.1" 204 0
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f586a50>
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac1c50>
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_80dc5d529d100c8ef70a39f0636c5525.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f677490>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_80dc5d529d100c8ef70a39f0636c5525.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_80dc5d529d100c8ef70a39f0636c5525.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea08dd0>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f586790>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f9590>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_98910f953d557e1cf7ed5efb544e059f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4d2d0>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1f590>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_a079b152ab07956fe2fc008f36026c71.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eab7810>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_98910f953d557e1cf7ed5efb544e059f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_98910f953d557e1cf7ed5efb544e059f.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f677e90>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F1d%252Fc71d6eae3973c2d497f12df27a3e10ca%252Fpa%252FXL20163_a079b152ab07956fe2fc008f36026c71.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_a079b152ab07956fe2fc008f36026c71.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d087450b-551e-5784-8900-034cc5670ac3
2026-03-28 10:36:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d087450b-551e-5784-8900-034cc5670ac3, skipping ID generation
2026-03-28 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 1
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d087450b-551e-5784-8900-034cc5670ac3 sending to next pipeline
2026-03-28 10:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d087450b-551e-5784-8900-034cc5670ac3, identifier: XL20163
2026-03-28 10:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-28 10:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-28 10:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163 to the API
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_a079b152ab07956fe2fc008f36026c71.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.4L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'd087450b-551e-5784-8900-034cc5670ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL20163',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 133363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_a079b152ab07956fe2fc008f36026c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_f3ddf9a9f920e7c9903f0b7e56b89e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_9aa4aff1b46081ce2e132ea75bdc287d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_06e8e8fedd0119cc659316b186ff8f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d087450b-551e-5784-8900-034cc5670ac3/d087450b-551e-5784-8900-034cc5670ac3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/1d/c71d6eae3973c2d497f12df27a3e10ca/pa/XL20163_73b12d92bbcc224629ddccf5119ba1be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V70 2.5',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Saving data for XL20163: {'created_time': 1774694209.081186, 'last_price_update_time': 1774694209.081196, 'auction_closing_time': 1774885876.0}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL20163') HTTP/1.1" 204 0
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_c157529e1d4196208335ee51b2d5d803.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f635210>
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F32%252F61320715e7ee52b91516c5574d92058b%252Fpa%252FYV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg saved to cache
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 490edfac-ca32-5de2-a444-b7b49007d687
2026-03-28 10:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 490edfac-ca32-5de2-a444-b7b49007d687, skipping ID generation
2026-03-28 10:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 1
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 490edfac-ca32-5de2-a444-b7b49007d687 sending to next pipeline
2026-03-28 10:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490edfac-ca32-5de2-a444-b7b49007d687, identifier: YV73995
2026-03-28 10:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-28 10:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-28 10:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995 to the API
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:19Z',
 'fuel_type': 'petrol',
 'id': '490edfac-ca32-5de2-a444-b7b49007d687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV73995',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 94429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_98910f953d557e1cf7ed5efb544e059f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_96b5b34c326002aa4e8c744b3d4d6260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_7ea9f3dd7be3290da9ce64cd54d5715f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c3bd52fb7b3e1a11f9371b557b53166c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_956f51a1e6fe85966d44c5b006d5cec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_1ca2145f1e4a344eb4ab773a5ea739c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_aa0a1cc56bbff6eb951f868db470e9d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_80dc5d529d100c8ef70a39f0636c5525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_ad78cfd870ef110f31cfcbbe69d74df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490edfac-ca32-5de2-a444-b7b49007d687/490edfac-ca32-5de2-a444-b7b49007d687_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/32/61320715e7ee52b91516c5574d92058b/pa/YV73995_c41d8b873b4c5ccd2c7a92f65ec86381.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2019}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Saving data for YV73995: {'created_time': 1774694209.611673, 'last_price_update_time': 1774694209.611684, 'auction_closing_time': 1774885039.0}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV73995') HTTP/1.1" 204 0
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea09910>
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_c157529e1d4196208335ee51b2d5d803.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_c157529e1d4196208335ee51b2d5d803.jpg saved to cache
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:49 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9629 | hits on page: 40
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR82375%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for SR82375: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH90697%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for FH90697: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV38391%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for YV38391: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE46726%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for XE46726: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW69156%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for NW69156: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG07809%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for SG07809: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD03846%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for YD03846: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_25b227782fb7988858f6001eeec59993.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebca250>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92ded0>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_25b227782fb7988858f6001eeec59993.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_25b227782fb7988858f6001eeec59993.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca5d50>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea0b410>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_750180302db05b94fb293ae497ecc692.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa39d0>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_750180302db05b94fb293ae497ecc692.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_750180302db05b94fb293ae497ecc692.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb13910>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb9590>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f787b50>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea71c10>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fe5%252F11e5669fceed68341324ff6243bf5eb8%252Fpa%252FGW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 384a9e63-8737-5102-a5a5-34fd13756f2b
2026-03-28 10:36:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 384a9e63-8737-5102-a5a5-34fd13756f2b, skipping ID generation
2026-03-28 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 1
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 384a9e63-8737-5102-a5a5-34fd13756f2b sending to next pipeline
2026-03-28 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 384a9e63-8737-5102-a5a5-34fd13756f2b, identifier: GW53776
2026-03-28 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-28 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-28 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776 to the API
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:48:04Z',
 'fuel_type': 'petrol',
 'id': '384a9e63-8737-5102-a5a5-34fd13756f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW53776',
 'listing': 'auction',
 'location': 'DE, Buchholz',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 46165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_d9d56b92ba69a692bcf2f7100fa430e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ac515a1cf06305e2d05f018c7cd75db2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_750180302db05b94fb293ae497ecc692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7f6381ddce577f2bab14a609f8df1d5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_7fa539b4ea0d3e7c42614a99bbf2d6bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_c157529e1d4196208335ee51b2d5d803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_3ffe2ed9be79147a3d1caa31f13dbf56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_afee58e9594b8008b2ca9d03ac86ec53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_ba0786cb2a733c0c538f6058f21dc159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384a9e63-8737-5102-a5a5-34fd13756f2b/384a9e63-8737-5102-a5a5-34fd13756f2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/e5/11e5669fceed68341324ff6243bf5eb8/pa/GW53776_5dfe71e86860d73830fe67ba040a9e42.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-28 10:36:51 [auto1.de] INFO: Saving data for GW53776: {'created_time': 1774694211.854835, 'last_price_update_time': 1774694211.854845, 'auction_closing_time': 1774885684.0}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW53776') HTTP/1.1" 204 0
2026-03-28 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV90594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebba590>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg saved to cache
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_9b8c590269af8436b2c213de17d8269d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eca6190>
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg saved to cache
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55a4d250>
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_9b8c590269af8436b2c213de17d8269d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_9b8c590269af8436b2c213de17d8269d.jpg saved to cache
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_845b49f1a9471b01d956c53b29c848d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f785910>
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ffa%252F48fa0c928c9255b627e97f0b7e8f4c37%252Fpa%252FRW03523_845b49f1a9471b01d956c53b29c848d7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_845b49f1a9471b01d956c53b29c848d7.jpg saved to cache
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae
2026-03-28 10:36:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae, skipping ID generation
2026-03-28 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 1
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae sending to next pipeline
2026-03-28 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae, identifier: RW03523
2026-03-28 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-28 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-28 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523 to the API
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_845b49f1a9471b01d956c53b29c848d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'petrol',
 'id': '95b405e9-85af-5cdc-a4f4-7fec7227c6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW03523',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 39336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_edcffd823c6211d5e778df48c2ee99b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3432697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_845b49f1a9471b01d956c53b29c848d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3522665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_9b8c590269af8436b2c213de17d8269d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3410742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_f1be44315d61b7cc3ec8f9a6b770cbc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_69bcc0f06f43cb191cdd64e0fc5adf94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3252859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_629d8c65c1ed0eccca075bff718cd8f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3660546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_b3eca2433ae607ff91e93cd9bb7d7682.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_dc6a31e4a508cc30b7769da2c29b99bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_25b227782fb7988858f6001eeec59993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b405e9-85af-5cdc-a4f4-7fec7227c6ae/95b405e9-85af-5cdc-a4f4-7fec7227c6ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/fa/48fa0c928c9255b627e97f0b7e8f4c37/pa/RW03523_56b109684ca00aede38e66696f153adb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Saving data for RW03523: {'created_time': 1774694213.021457, 'last_price_update_time': 1774694213.021471, 'auction_closing_time': 1774885551.0}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW03523') HTTP/1.1" 204 0
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT95392> (referer: https://www.auto1.com/v1/car-details-view/NT95392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-28 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e07818-2481-54ef-8dcf-68e508dccf12 with scrape type 1
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7e07818-2481-54ef-8dcf-68e508dccf12
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_f94ddc0f954c42929684637dafb47ff5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_f94ddc0f954c42929684637dafb47ff5.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_2a85890d28d0c55c6a9e66eda647d6e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_2a85890d28d0c55c6a9e66eda647d6e7.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_ffeec52e96ad16f59f78da41e90f4980.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_ffeec52e96ad16f59f78da41e90f4980.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_9f75fbf9cece63b6306e8e612561b593.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9f75fbf9cece63b6306e8e612561b593.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_5086ac0c36e149eaebfde7c3ad442a8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_5086ac0c36e149eaebfde7c3ad442a8d.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_08529f89f08c95afca3c0c0da7027a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_08529f89f08c95afca3c0c0da7027a85.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_e95926a25e37ad1c4f92ec4c905f0599.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_e95926a25e37ad1c4f92ec4c905f0599.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_9a646dc93cc5d0484c48f842d019b19f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9a646dc93cc5d0484c48f842d019b19f.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_a3dfefc9a92e6426d880ce3c8c6a2f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_a3dfefc9a92e6426d880ce3c8c6a2f2a.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F97%252F499783937db115b86044215e9d0627e8%252Fpa%252FNT95392_63555692cdecdc4ef78135da6cbb6a1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_63555692cdecdc4ef78135da6cbb6a1a.jpg already downloaded
2026-03-28 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e07818-2481-54ef-8dcf-68e508dccf12, identifier: NT95392
2026-03-28 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-28 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-28 10:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392 to the API
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT95392>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'e7e07818-2481-54ef-8dcf-68e508dccf12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT95392',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 124277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_f94ddc0f954c42929684637dafb47ff5.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_2a85890d28d0c55c6a9e66eda647d6e7.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_ffeec52e96ad16f59f78da41e90f4980.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9f75fbf9cece63b6306e8e612561b593.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_5086ac0c36e149eaebfde7c3ad442a8d.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_08529f89f08c95afca3c0c0da7027a85.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_e95926a25e37ad1c4f92ec4c905f0599.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9a646dc93cc5d0484c48f842d019b19f.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_a3dfefc9a92e6426d880ce3c8c6a2f2a.jpg',
                'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_63555692cdecdc4ef78135da6cbb6a1a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_f94ddc0f954c42929684637dafb47ff5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_2a85890d28d0c55c6a9e66eda647d6e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_ffeec52e96ad16f59f78da41e90f4980.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9f75fbf9cece63b6306e8e612561b593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_5086ac0c36e149eaebfde7c3ad442a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_08529f89f08c95afca3c0c0da7027a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_e95926a25e37ad1c4f92ec4c905f0599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_9a646dc93cc5d0484c48f842d019b19f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_a3dfefc9a92e6426d880ce3c8c6a2f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7e07818-2481-54ef-8dcf-68e508dccf12/e7e07818-2481-54ef-8dcf-68e508dccf12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/97/499783937db115b86044215e9d0627e8/pa/NT95392_63555692cdecdc4ef78135da6cbb6a1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [auto1.de] INFO: Saving data for NT95392: {'created_time': 1774694214.796644, 'last_price_update_time': 1774694214.796659, 'auction_closing_time': 1774885690.0}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT95392') HTTP/1.1" 204 0
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN43056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA78869> (referer: https://www.auto1.com/v1/car-details-view/BA78869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA68058> (referer: https://www.auto1.com/v1/car-details-view/WA68058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-28 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d50ff8-0666-5550-b36e-7b62fea35fd5 with scrape type 1
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95d50ff8-0666-5550-b36e-7b62fea35fd5
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_1d91c03084dfcdfcfe81a35a2a5b2e7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1d91c03084dfcdfcfe81a35a2a5b2e7d.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_9d5f0847a33e29db49489beebda4103a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_9d5f0847a33e29db49489beebda4103a.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_1dcc0212946627b16cb46ef4ebf520df.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1dcc0212946627b16cb46ef4ebf520df.jpg already downloaded
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_5a5f5c541bdda3791cbecb4ca12f1c6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_5a5f5c541bdda3791cbecb4ca12f1c6b.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_d8f5d70636400aea31ca6737540f4be0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_d8f5d70636400aea31ca6737540f4be0.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_f219741d8d8c2991eb819f6d6ebb25cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_f219741d8d8c2991eb819f6d6ebb25cd.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_2354aea5bf874904cf372d51b90de1b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_2354aea5bf874904cf372d51b90de1b0.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_4bfee43616d56dc6ec88396499f5a94d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_4bfee43616d56dc6ec88396499f5a94d.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_c3a2c532925841143e8c12519629819a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_c3a2c532925841143e8c12519629819a.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F73%252F96732def9526aa5ba59df176521ed904%252Fpa%252FBA78869_b4dd0d9f72e97d15cde126c52e6fa1ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_b4dd0d9f72e97d15cde126c52e6fa1ce.jpg already downloaded
2026-03-28 10:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95d50ff8-0666-5550-b36e-7b62fea35fd5, identifier: BA78869
2026-03-28 10:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-28 10:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-28 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869 to the API
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BA78869>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:41Z',
 'fuel_type': 'diesel',
 'id': '95d50ff8-0666-5550-b36e-7b62fea35fd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA78869',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 360764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1d91c03084dfcdfcfe81a35a2a5b2e7d.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_9d5f0847a33e29db49489beebda4103a.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1dcc0212946627b16cb46ef4ebf520df.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_5a5f5c541bdda3791cbecb4ca12f1c6b.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_d8f5d70636400aea31ca6737540f4be0.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_f219741d8d8c2991eb819f6d6ebb25cd.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_2354aea5bf874904cf372d51b90de1b0.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_4bfee43616d56dc6ec88396499f5a94d.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_c3a2c532925841143e8c12519629819a.jpg',
                'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_b4dd0d9f72e97d15cde126c52e6fa1ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1d91c03084dfcdfcfe81a35a2a5b2e7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_9d5f0847a33e29db49489beebda4103a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_1dcc0212946627b16cb46ef4ebf520df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_5a5f5c541bdda3791cbecb4ca12f1c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_d8f5d70636400aea31ca6737540f4be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_f219741d8d8c2991eb819f6d6ebb25cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_2354aea5bf874904cf372d51b90de1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_4bfee43616d56dc6ec88396499f5a94d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_c3a2c532925841143e8c12519629819a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95d50ff8-0666-5550-b36e-7b62fea35fd5/95d50ff8-0666-5550-b36e-7b62fea35fd5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/73/96732def9526aa5ba59df176521ed904/pa/BA78869_b4dd0d9f72e97d15cde126c52e6fa1ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [auto1.de] INFO: Saving data for BA78869: {'created_time': 1774694215.54303, 'last_price_update_time': 1774694215.543041, 'auction_closing_time': 1774883501.0}
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA78869') HTTP/1.1" 204 0
2026-03-28 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-28 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with scrape type 1
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_0eb3fd312f3383b408b24ee36cacad44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_0eb3fd312f3383b408b24ee36cacad44.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_b303492204a4b2b3b71d0c368181d37b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b303492204a4b2b3b71d0c368181d37b.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_58db679f91cff09902c559af2d873cca.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_58db679f91cff09902c559af2d873cca.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_5b5ef0a69829d6200f522569d69017b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_5b5ef0a69829d6200f522569d69017b4.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_61796d93d235d258927aaf2b01dd1e43.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_61796d93d235d258927aaf2b01dd1e43.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_c3f206def92b9cea9b648aed88d33ba1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_c3f206def92b9cea9b648aed88d33ba1.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_b02cfcef40d70bf8534de347b41fd12e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b02cfcef40d70bf8534de347b41fd12e.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_8ea8e0a1947cab31475f42a098d75701.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_8ea8e0a1947cab31475f42a098d75701.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_7b995b37d74b72d384abcf00fce86763.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_7b995b37d74b72d384abcf00fce86763.jpg already downloaded
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b1f02dfddf563fa0329d45358e998%252Fpa%252FWA68058_00f33a343213b017ef3fc123c96b7ffc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_00f33a343213b017ef3fc123c96b7ffc.jpg already downloaded
2026-03-28 10:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb, identifier: WA68058
2026-03-28 10:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-28 10:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-28 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058 to the API
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA68058>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:25Z',
 'fuel_type': 'petrol',
 'id': 'b16628e5-1d13-5bc3-aefe-ab3aedcaabcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68058',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 105623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_0eb3fd312f3383b408b24ee36cacad44.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b303492204a4b2b3b71d0c368181d37b.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_58db679f91cff09902c559af2d873cca.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_5b5ef0a69829d6200f522569d69017b4.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_61796d93d235d258927aaf2b01dd1e43.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_c3f206def92b9cea9b648aed88d33ba1.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b02cfcef40d70bf8534de347b41fd12e.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_8ea8e0a1947cab31475f42a098d75701.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_7b995b37d74b72d384abcf00fce86763.jpg',
                'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_00f33a343213b017ef3fc123c96b7ffc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_0eb3fd312f3383b408b24ee36cacad44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b303492204a4b2b3b71d0c368181d37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_58db679f91cff09902c559af2d873cca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_5b5ef0a69829d6200f522569d69017b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_61796d93d235d258927aaf2b01dd1e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_c3f206def92b9cea9b648aed88d33ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_b02cfcef40d70bf8534de347b41fd12e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_8ea8e0a1947cab31475f42a098d75701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_7b995b37d74b72d384abcf00fce86763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b16628e5-1d13-5bc3-aefe-ab3aedcaabcb/b16628e5-1d13-5bc3-aefe-ab3aedcaabcb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b1f02dfddf563fa0329d45358e998/pa/WA68058_00f33a343213b017ef3fc123c96b7ffc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-28 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-28 10:36:56 [auto1.de] INFO: Saving data for WA68058: {'created_time': 1774694216.161216, 'last_price_update_time': 1774694216.161226, 'auction_closing_time': 1774885945.0}
2026-03-28 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68058') HTTP/1.1" 204 0
2026-03-28 10:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF00811> (referer: https://www.auto1.com/v1/car-details-view/RF00811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-28 10:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155c56ae-f46b-51b9-9e6e-c431a6bce839 with scrape type 1
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 155c56ae-f46b-51b9-9e6e-c431a6bce839
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_d82c8a67dfab9019b4dbebf64c233d36.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_d82c8a67dfab9019b4dbebf64c233d36.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_1256bf4ae12d67a4ced13b2453c5c694.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_1256bf4ae12d67a4ced13b2453c5c694.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_dac174bd28d9e318e0d996e8e6a3dd09.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_dac174bd28d9e318e0d996e8e6a3dd09.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_9719caaef153384ae94fb233710fa129.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_9719caaef153384ae94fb233710fa129.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_c41c7c7e76189f205cfea721b103906b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c41c7c7e76189f205cfea721b103906b.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_bbec153568ce664b8d79557dc5d08e79.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_bbec153568ce664b8d79557dc5d08e79.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_c4519661452374bb0afa1428cdc52c31.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c4519661452374bb0afa1428cdc52c31.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_8fa0a1c4e2e3cd6af2c2d1fe64228486.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_8fa0a1c4e2e3cd6af2c2d1fe64228486.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_5b09bd2b6fc39cef7bf95ada9b21c1e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_5b09bd2b6fc39cef7bf95ada9b21c1e4.jpg already downloaded
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fa3%252F8ba3cd725119269b0f423564d02487dd%252Fpa%252FRF00811_99d0e0b04f0e53b142c07ebfd1a35b92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_99d0e0b04f0e53b142c07ebfd1a35b92.jpg already downloaded
2026-03-28 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 155c56ae-f46b-51b9-9e6e-c431a6bce839, identifier: RF00811
2026-03-28 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-28 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-28 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811 to the API
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF00811>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'diesel',
 'id': '155c56ae-f46b-51b9-9e6e-c431a6bce839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF00811',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 197615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_d82c8a67dfab9019b4dbebf64c233d36.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_1256bf4ae12d67a4ced13b2453c5c694.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_dac174bd28d9e318e0d996e8e6a3dd09.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_9719caaef153384ae94fb233710fa129.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c41c7c7e76189f205cfea721b103906b.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_bbec153568ce664b8d79557dc5d08e79.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c4519661452374bb0afa1428cdc52c31.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_8fa0a1c4e2e3cd6af2c2d1fe64228486.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_5b09bd2b6fc39cef7bf95ada9b21c1e4.jpg',
                'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_99d0e0b04f0e53b142c07ebfd1a35b92.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_d82c8a67dfab9019b4dbebf64c233d36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589940,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_1256bf4ae12d67a4ced13b2453c5c694.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_dac174bd28d9e318e0d996e8e6a3dd09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_9719caaef153384ae94fb233710fa129.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c41c7c7e76189f205cfea721b103906b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_bbec153568ce664b8d79557dc5d08e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_c4519661452374bb0afa1428cdc52c31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_8fa0a1c4e2e3cd6af2c2d1fe64228486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523000,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_5b09bd2b6fc39cef7bf95ada9b21c1e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155c56ae-f46b-51b9-9e6e-c431a6bce839/155c56ae-f46b-51b9-9e6e-c431a6bce839_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/a3/8ba3cd725119269b0f423564d02487dd/pa/RF00811_99d0e0b04f0e53b142c07ebfd1a35b92.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Bi-Turbo Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [auto1.de] INFO: Saving data for RF00811: {'created_time': 1774694219.449667, 'last_price_update_time': 1774694219.449677, 'auction_closing_time': 1774883074.0}
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF00811') HTTP/1.1" 204 0
2026-03-28 10:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH57829> (referer: https://www.auto1.com/v1/car-details-view/EH57829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-28 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97710850-f158-5fa6-af3c-4dad60e26c07 with scrape type 1
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97710850-f158-5fa6-af3c-4dad60e26c07
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_97d3b1ae667df7311c8edf1825ee396c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_97d3b1ae667df7311c8edf1825ee396c.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_a93d21bd32fe782ef110793fccd37ae0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_a93d21bd32fe782ef110793fccd37ae0.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_b379003805f977bd275876311e08d16a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_b379003805f977bd275876311e08d16a.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_4f1103ad6cffd817b29b2e5728b58d4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_4f1103ad6cffd817b29b2e5728b58d4b.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_3cf5cd98d8acdea6a82a90211ee0560b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3cf5cd98d8acdea6a82a90211ee0560b.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_ccf8347a9010623ed3289ec2ba5400b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_ccf8347a9010623ed3289ec2ba5400b9.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_550f13e7eaa309b5c69cf6e6ce16e071.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_550f13e7eaa309b5c69cf6e6ce16e071.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_3097521cf97b6cbb354c31e4f28f6aa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3097521cf97b6cbb354c31e4f28f6aa2.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_5c11b73c09e0b5d58963d5907d5cdb17.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_5c11b73c09e0b5d58963d5907d5cdb17.jpg already downloaded
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6f045f8201a66f09a567442064013%252Fpa%252FEH57829_c1b54c48bde0727772679b414dd45f75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_c1b54c48bde0727772679b414dd45f75.jpg already downloaded
2026-03-28 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97710850-f158-5fa6-af3c-4dad60e26c07, identifier: EH57829
2026-03-28 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-28 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-28 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829 to the API
2026-03-28 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH57829>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'petrol',
 'id': '97710850-f158-5fa6-af3c-4dad60e26c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH57829',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 20429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_97d3b1ae667df7311c8edf1825ee396c.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_a93d21bd32fe782ef110793fccd37ae0.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_b379003805f977bd275876311e08d16a.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_4f1103ad6cffd817b29b2e5728b58d4b.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3cf5cd98d8acdea6a82a90211ee0560b.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_ccf8347a9010623ed3289ec2ba5400b9.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_550f13e7eaa309b5c69cf6e6ce16e071.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3097521cf97b6cbb354c31e4f28f6aa2.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_5c11b73c09e0b5d58963d5907d5cdb17.jpg',
                'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_c1b54c48bde0727772679b414dd45f75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_97d3b1ae667df7311c8edf1825ee396c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_a93d21bd32fe782ef110793fccd37ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_b379003805f977bd275876311e08d16a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_4f1103ad6cffd817b29b2e5728b58d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3cf5cd98d8acdea6a82a90211ee0560b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_ccf8347a9010623ed3289ec2ba5400b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_550f13e7eaa309b5c69cf6e6ce16e071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_3097521cf97b6cbb354c31e4f28f6aa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_5c11b73c09e0b5d58963d5907d5cdb17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97710850-f158-5fa6-af3c-4dad60e26c07/97710850-f158-5fa6-af3c-4dad60e26c07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6f045f8201a66f09a567442064013/pa/EH57829_c1b54c48bde0727772679b414dd45f75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 25 Aniversario',
 'transmission': 'manual',
 'trim': '25 Aniversario',
 'year': 2016}
2026-03-28 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-28 10:37:00 [auto1.de] INFO: Saving data for EH57829: {'created_time': 1774694220.241338, 'last_price_update_time': 1774694220.24135, 'auction_closing_time': 1774884236.0}
2026-03-28 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH57829') HTTP/1.1" 204 0
2026-03-28 10:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR88922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:06 [scrapy.extensions.logstats] INFO: Crawled 201 pages (at 40 pages/min), scraped 180 items (at 46 items/min)
2026-03-28 10:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:37:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.939(s), this was the 1st time calling it.
2026-03-28 10:37:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.763975363192228 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK48004> (referer: https://www.auto1.com/v1/car-details-view/EK48004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-28 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with scrape type 1
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_580c03a244b77adf98138b23ba3bd4c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_580c03a244b77adf98138b23ba3bd4c5.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_50a0d3eebde51baa837bf7a98e9f5771.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_50a0d3eebde51baa837bf7a98e9f5771.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_dde099694bd92a0020559330b0c05b3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_dde099694bd92a0020559330b0c05b3e.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_4b60241b54cb186f1fe630fd31a00591.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_4b60241b54cb186f1fe630fd31a00591.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_3668be3b141723ad703f1f38539f4fe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_3668be3b141723ad703f1f38539f4fe5.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_38638fbc598c5a4bcad411ab62d471a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_38638fbc598c5a4bcad411ab62d471a4.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_19c715263294a358b81978ca3cc58999.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_19c715263294a358b81978ca3cc58999.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_0f0b3063273585a40375325e0f36aeb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_0f0b3063273585a40375325e0f36aeb6.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_b53d3d8471a922145cdd2fa0a28a456e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_b53d3d8471a922145cdd2fa0a28a456e.jpg already downloaded
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F40%252F7c4052c579818e96cc77de2850022bbd%252Fpa%252FEK48004_590a0199f2a1013afd2ac223f42b6fdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_590a0199f2a1013afd2ac223f42b6fdc.jpg already downloaded
2026-03-28 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8, identifier: EK48004
2026-03-28 10:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-28 10:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-28 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004 to the API
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK48004>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:22:00Z',
 'fuel_type': 'diesel',
 'id': 'dd23a141-f8a7-52e7-ac9e-14210d0fe2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK48004',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 245523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_580c03a244b77adf98138b23ba3bd4c5.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_50a0d3eebde51baa837bf7a98e9f5771.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_dde099694bd92a0020559330b0c05b3e.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_4b60241b54cb186f1fe630fd31a00591.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_3668be3b141723ad703f1f38539f4fe5.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_38638fbc598c5a4bcad411ab62d471a4.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_19c715263294a358b81978ca3cc58999.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_0f0b3063273585a40375325e0f36aeb6.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_b53d3d8471a922145cdd2fa0a28a456e.jpg',
                'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_590a0199f2a1013afd2ac223f42b6fdc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_580c03a244b77adf98138b23ba3bd4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_50a0d3eebde51baa837bf7a98e9f5771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_dde099694bd92a0020559330b0c05b3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_4b60241b54cb186f1fe630fd31a00591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_3668be3b141723ad703f1f38539f4fe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_38638fbc598c5a4bcad411ab62d471a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_19c715263294a358b81978ca3cc58999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_0f0b3063273585a40375325e0f36aeb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_b53d3d8471a922145cdd2fa0a28a456e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd23a141-f8a7-52e7-ac9e-14210d0fe2a8/dd23a141-f8a7-52e7-ac9e-14210d0fe2a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/40/7c4052c579818e96cc77de2850022bbd/pa/EK48004_590a0199f2a1013afd2ac223f42b6fdc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-28 10:37:15 [auto1.de] INFO: Saving data for EK48004: {'created_time': 1774694235.166702, 'last_price_update_time': 1774694235.166713, 'auction_closing_time': 1774884120.0}
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK48004') HTTP/1.1" 204 0
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG18082> (referer: https://www.auto1.com/v1/car-details-view/PG18082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-28 10:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 1
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_c4928445634f3e2ca85a5e5a874915f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c4928445634f3e2ca85a5e5a874915f3.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_c535f5294e463a28690c19d708bb39eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c535f5294e463a28690c19d708bb39eb.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_9c55a2c3559451d4978d3a6c4975de81.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_9c55a2c3559451d4978d3a6c4975de81.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_de6b395c08465b2ead64ec9a429e9795.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_de6b395c08465b2ead64ec9a429e9795.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_f13af0d1b4727843c463d76fa994663d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_f13af0d1b4727843c463d76fa994663d.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg not downloaded yet
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg not downloaded yet
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c535f5294e463a28690c19d708bb39eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c4928445634f3e2ca85a5e5a874915f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaef110>
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_c535f5294e463a28690c19d708bb39eb.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c535f5294e463a28690c19d708bb39eb.jpg saved to cache
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec49c90>
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg saved to cache
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac6610>
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_c4928445634f3e2ca85a5e5a874915f3.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c4928445634f3e2ca85a5e5a874915f3.jpg saved to cache
2026-03-28 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa7b10>
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb90d0>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_f13af0d1b4727843c463d76fa994663d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea09710>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_f13af0d1b4727843c463d76fa994663d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_f13af0d1b4727843c463d76fa994663d.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_de6b395c08465b2ead64ec9a429e9795.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f623890>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_de6b395c08465b2ead64ec9a429e9795.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_de6b395c08465b2ead64ec9a429e9795.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_9c55a2c3559451d4978d3a6c4975de81.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb5bfd0>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f79cf10>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7865d0>
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fc6%252Fbac6aac7c3542f8b8dda8d2b38d7a6df%252Fpa%252FPG18082_9c55a2c3559451d4978d3a6c4975de81.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_9c55a2c3559451d4978d3a6c4975de81.jpg saved to cache
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c85aeb97-4f94-58f2-afca-03f8884b1246
2026-03-28 10:37:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c85aeb97-4f94-58f2-afca-03f8884b1246, skipping ID generation
2026-03-28 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 1
2026-03-28 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c85aeb97-4f94-58f2-afca-03f8884b1246 sending to next pipeline
2026-03-28 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85aeb97-4f94-58f2-afca-03f8884b1246, identifier: PG18082
2026-03-28 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-28 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-28 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082 to the API
2026-03-28 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_9c55a2c3559451d4978d3a6c4975de81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:28:09Z',
 'fuel_type': 'petrol',
 'id': 'c85aeb97-4f94-58f2-afca-03f8884b1246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG18082',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 67980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c4928445634f3e2ca85a5e5a874915f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_6810c902dfa0dd29f13d6f20671eb9c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_c535f5294e463a28690c19d708bb39eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_9c55a2c3559451d4978d3a6c4975de81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2242863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_de6b395c08465b2ead64ec9a429e9795.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_b08b280535ec65ebc4f8c6acda8d4925.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_3380ba7464b679cf6724f587d6f4ce2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2400575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_f13af0d1b4727843c463d76fa994663d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_5768f04dc6a938c6e911d7cb66d8c726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c85aeb97-4f94-58f2-afca-03f8884b1246/c85aeb97-4f94-58f2-afca-03f8884b1246_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/c6/bac6aac7c3542f8b8dda8d2b38d7a6df/pa/PG18082_49c4bd44ced5b9ae8ea5d47471103b7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-28 10:37:20 [auto1.de] INFO: Saving data for PG18082: {'created_time': 1774694240.258648, 'last_price_update_time': 1774694240.258659, 'auction_closing_time': 1774884489.0}
2026-03-28 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG18082') HTTP/1.1" 204 0
2026-03-28 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR83304> (referer: https://www.auto1.com/v1/car-details-view/RR83304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-28 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 1
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_1a5b98c988e73432d303da6669b5e652.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_1a5b98c988e73432d303da6669b5e652.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_d482721bfcbaeb9aaef50f801d58d450.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_d482721bfcbaeb9aaef50f801d58d450.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_bbe33f0643eee076bd9fe754a72e428c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bbe33f0643eee076bd9fe754a72e428c.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_06461041023cfe937c563858c6657a7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_06461041023cfe937c563858c6657a7d.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_346bfc41363b56f0d7d4e697b4b21898.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_346bfc41363b56f0d7d4e697b4b21898.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_ec5db782700266bff437471a216ad131.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_ec5db782700266bff437471a216ad131.jpg not downloaded yet
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_0ebabdc44b619019adcbabca8376ff59.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_0ebabdc44b619019adcbabca8376ff59.jpg not downloaded yet
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM27503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_1a5b98c988e73432d303da6669b5e652.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bbe33f0643eee076bd9fe754a72e428c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_d482721bfcbaeb9aaef50f801d58d450.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea0ab90>
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_1a5b98c988e73432d303da6669b5e652.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_1a5b98c988e73432d303da6669b5e652.jpg saved to cache
2026-03-28 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e983b10>
2026-03-28 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_bbe33f0643eee076bd9fe754a72e428c.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bbe33f0643eee076bd9fe754a72e428c.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaf4e50>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d3a90>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_d482721bfcbaeb9aaef50f801d58d450.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_d482721bfcbaeb9aaef50f801d58d450.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_0ebabdc44b619019adcbabca8376ff59.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_ec5db782700266bff437471a216ad131.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea57a50>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_0ebabdc44b619019adcbabca8376ff59.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_0ebabdc44b619019adcbabca8376ff59.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_346bfc41363b56f0d7d4e697b4b21898.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb58c90>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_ec5db782700266bff437471a216ad131.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_ec5db782700266bff437471a216ad131.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d2650>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1ea90>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_346bfc41363b56f0d7d4e697b4b21898.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_346bfc41363b56f0d7d4e697b4b21898.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_06461041023cfe937c563858c6657a7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2b290>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg saved to cache
2026-03-28 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eaa3510>
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fbb%252Fbebb0459fe9848e5c9f43cf58da2d39f%252Fpa%252FRR83304_06461041023cfe937c563858c6657a7d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_06461041023cfe937c563858c6657a7d.jpg saved to cache
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d
2026-03-28 10:37:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d, skipping ID generation
2026-03-28 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 1
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d sending to next pipeline
2026-03-28 10:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d, identifier: RR83304
2026-03-28 10:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-28 10:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-28 10:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304 to the API
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_06461041023cfe937c563858c6657a7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:41Z',
 'fuel_type': 'petrol',
 'id': '82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR83304',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Mazda',
 'model': '5',
 'odometer': 164389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_1a5b98c988e73432d303da6669b5e652.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bf0e0dda2547a34b65a9d1303a37f19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_d482721bfcbaeb9aaef50f801d58d450.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2399999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_bbe33f0643eee076bd9fe754a72e428c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f3c230797835d72f6f6cc9cf53cc862f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_06461041023cfe937c563858c6657a7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_346bfc41363b56f0d7d4e697b4b21898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_f0e87da8a4228d852b65b66ecc08fdea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_ec5db782700266bff437471a216ad131.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d/82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2278461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/bb/bebb0459fe9848e5c9f43cf58da2d39f/pa/RR83304_0ebabdc44b619019adcbabca8376ff59.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2012}
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [auto1.de] INFO: Saving data for RR83304: {'created_time': 1774694244.551026, 'last_price_update_time': 1774694244.551037, 'auction_closing_time': 1774884641.0}
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR83304') HTTP/1.1" 204 0
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE39516> (referer: https://www.auto1.com/v1/car-details-view/UE39516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-28 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 1
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_bd86ec367057d5ccd889c75134a21770.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_bd86ec367057d5ccd889c75134a21770.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_5e191000c64e621e44899054e095395a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_5e191000c64e621e44899054e095395a.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_0e2f4b322213657dadeb356352ed6106.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_0e2f4b322213657dadeb356352ed6106.jpg not downloaded yet
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_bd86ec367057d5ccd889c75134a21770.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_33721e0b314bd7297b3f1f430c1af9af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_33721e0b314bd7297b3f1f430c1af9af.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg not downloaded yet
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg not downloaded yet
2026-03-28 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1a450>
2026-03-28 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_bd86ec367057d5ccd889c75134a21770.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_bd86ec367057d5ccd889c75134a21770.jpg saved to cache
2026-03-28 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_5e191000c64e621e44899054e095395a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_0e2f4b322213657dadeb356352ed6106.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9d2d10>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_5e191000c64e621e44899054e095395a.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_5e191000c64e621e44899054e095395a.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3f510>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecb9490>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f9d10>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f674590>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_0e2f4b322213657dadeb356352ed6106.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_0e2f4b322213657dadeb356352ed6106.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE20907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea56090>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_33721e0b314bd7297b3f1f430c1af9af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f7bc750>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f753610>
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_33721e0b314bd7297b3f1f430c1af9af.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_33721e0b314bd7297b3f1f430c1af9af.jpg saved to cache
2026-03-28 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f752b90>
2026-03-28 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F17%252Fed17b8d5ca2da234f2965773a1aec819%252Fpa%252FUE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg saved to cache
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e
2026-03-28 10:37:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e, skipping ID generation
2026-03-28 10:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 1
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e sending to next pipeline
2026-03-28 10:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e, identifier: UE39516
2026-03-28 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-28 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-28 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516 to the API
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:47Z',
 'fuel_type': 'petrol',
 'id': 'a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE39516',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 12585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_bd86ec367057d5ccd889c75134a21770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_5e191000c64e621e44899054e095395a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3401105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1d388eeecdcdf08db4a0d87c3dfa5eeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_c51d7b9183a1beec11a1b0ab27492a5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3027404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_ccb93f71f60fb22a785fe70e993b1e78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_1b69bbb6bbd718e926460cfa44e0a176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_0e2f4b322213657dadeb356352ed6106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_33721e0b314bd7297b3f1f430c1af9af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_feafc01186a3dd4318b8f0a67bbc7919.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e/a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910388,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/17/ed17b8d5ca2da234f2965773a1aec819/pa/UE39516_2b30e89be3783a5b3b8bd03f0208f0ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [auto1.de] INFO: Saving data for UE39516: {'created_time': 1774694246.582082, 'last_price_update_time': 1774694246.582094, 'auction_closing_time': 1774882907.0}
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE39516') HTTP/1.1" 204 0
2026-03-28 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM93366> (referer: https://www.auto1.com/v1/car-details-view/GM93366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-28 10:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 1
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_b4360efcd819d0cc3df838e04d282319.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_b4360efcd819d0cc3df838e04d282319.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_dc5c88e8fe482effd859898236303811.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_dc5c88e8fe482effd859898236303811.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_688d0c0b598fd07317180bcbaded729a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_688d0c0b598fd07317180bcbaded729a.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_c807e94c44b98813d53bbba65d498510.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_c807e94c44b98813d53bbba65d498510.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_3284093e94ee2ca251af7f6b58528f72.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_3284093e94ee2ca251af7f6b58528f72.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_4257473211f262bce9feb78bf273f3b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_4257473211f262bce9feb78bf273f3b4.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_43ccf37aefeeb867836494d6ff93f627.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_43ccf37aefeeb867836494d6ff93f627.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_770b72da1eafedbbb92ff6a72a27710f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_770b72da1eafedbbb92ff6a72a27710f.jpg not downloaded yet
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_55e5584c13e13a6109d0effc77bb6230.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_55e5584c13e13a6109d0effc77bb6230.jpg not downloaded yet
2026-03-28 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_b4360efcd819d0cc3df838e04d282319.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_c807e94c44b98813d53bbba65d498510.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_688d0c0b598fd07317180bcbaded729a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_dc5c88e8fe482effd859898236303811.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_3284093e94ee2ca251af7f6b58528f72.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb5b1d0>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_770b72da1eafedbbb92ff6a72a27710f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_55e5584c13e13a6109d0effc77bb6230.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1a010>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_b4360efcd819d0cc3df838e04d282319.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_b4360efcd819d0cc3df838e04d282319.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c1690>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_c807e94c44b98813d53bbba65d498510.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_c807e94c44b98813d53bbba65d498510.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e974fd0>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_688d0c0b598fd07317180bcbaded729a.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_688d0c0b598fd07317180bcbaded729a.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e903c90>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_dc5c88e8fe482effd859898236303811.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_dc5c88e8fe482effd859898236303811.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c15d0>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_3284093e94ee2ca251af7f6b58528f72.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_3284093e94ee2ca251af7f6b58528f72.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec01f10>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_770b72da1eafedbbb92ff6a72a27710f.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_770b72da1eafedbbb92ff6a72a27710f.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e2510>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_55e5584c13e13a6109d0effc77bb6230.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_55e5584c13e13a6109d0effc77bb6230.jpg saved to cache
2026-03-28 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_43ccf37aefeeb867836494d6ff93f627.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_4257473211f262bce9feb78bf273f3b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f778450>
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_43ccf37aefeeb867836494d6ff93f627.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_43ccf37aefeeb867836494d6ff93f627.jpg saved to cache
2026-03-28 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea2a190>
2026-03-28 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F00%252F7100d079c67c1f56e214c6cc08894c6c%252Fpa%252FGM93366_4257473211f262bce9feb78bf273f3b4.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_4257473211f262bce9feb78bf273f3b4.jpg saved to cache
2026-03-28 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab
2026-03-28 10:37:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b8a18e4-a97b-570d-9d0c-32265795a1ab, skipping ID generation
2026-03-28 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 1
2026-03-28 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab sending to next pipeline
2026-03-28 10:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b8a18e4-a97b-570d-9d0c-32265795a1ab, identifier: GM93366
2026-03-28 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-28 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-28 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366 to the API
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_4257473211f262bce9feb78bf273f3b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 71,
 'expiration_date': '2026-03-30T15:19:41Z',
 'fuel_type': 'petrol',
 'id': '9b8a18e4-a97b-570d-9d0c-32265795a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93366',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 56254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_cd642b3f59c7229e3f9ee7f25e7fbb91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_b4360efcd819d0cc3df838e04d282319.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_dc5c88e8fe482effd859898236303811.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_688d0c0b598fd07317180bcbaded729a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2334977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_c807e94c44b98813d53bbba65d498510.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_3284093e94ee2ca251af7f6b58528f72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2035674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_4257473211f262bce9feb78bf273f3b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_43ccf37aefeeb867836494d6ff93f627.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_770b72da1eafedbbb92ff6a72a27710f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8a18e4-a97b-570d-9d0c-32265795a1ab/9b8a18e4-a97b-570d-9d0c-32265795a1ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/00/7100d079c67c1f56e214c6cc08894c6c/pa/GM93366_55e5584c13e13a6109d0effc77bb6230.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Select+',
 'transmission': 'manual',
 'trim': 'Select+',
 'year': 2023}
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-28 10:37:28 [auto1.de] INFO: Saving data for GM93366: {'created_time': 1774694248.664675, 'last_price_update_time': 1774694248.664686, 'auction_closing_time': 1774883981.0}
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93366') HTTP/1.1" 204 0
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR88922> (referer: https://www.auto1.com/v1/car-details-view/DR88922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-28 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 1
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_8865f5acb1901f3486517a225bdf905d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_8865f5acb1901f3486517a225bdf905d.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_ca87be22a86a5aed0fd158fcbd006007.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ca87be22a86a5aed0fd158fcbd006007.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_383c65ce7595f237fd09a02d7d277f72.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_383c65ce7595f237fd09a02d7d277f72.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_51a250335293555ffc9dad8ac4e303fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_51a250335293555ffc9dad8ac4e303fa.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_0735142e5a56d6fe1125229e2cee99f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_0735142e5a56d6fe1125229e2cee99f9.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_5da448178cfbf1280f974e84ad54d401.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_5da448178cfbf1280f974e84ad54d401.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_135e9d9f6502065b545e7e82da6400d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_135e9d9f6502065b545e7e82da6400d6.jpg not downloaded yet
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_8865f5acb1901f3486517a225bdf905d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a3ad0>
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_8865f5acb1901f3486517a225bdf905d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_8865f5acb1901f3486517a225bdf905d.jpg saved to cache
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_51a250335293555ffc9dad8ac4e303fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_5da448178cfbf1280f974e84ad54d401.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e3d10>
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg saved to cache
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_383c65ce7595f237fd09a02d7d277f72.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5a2a90>
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea57110>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_51a250335293555ffc9dad8ac4e303fa.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_51a250335293555ffc9dad8ac4e303fa.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e982890>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea1a190>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_5da448178cfbf1280f974e84ad54d401.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_5da448178cfbf1280f974e84ad54d401.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebc9710>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_383c65ce7595f237fd09a02d7d277f72.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_383c65ce7595f237fd09a02d7d277f72.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ca87be22a86a5aed0fd158fcbd006007.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_135e9d9f6502065b545e7e82da6400d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_0735142e5a56d6fe1125229e2cee99f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb2ad90>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_ca87be22a86a5aed0fd158fcbd006007.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ca87be22a86a5aed0fd158fcbd006007.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ec108d0>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_135e9d9f6502065b545e7e82da6400d6.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_135e9d9f6502065b545e7e82da6400d6.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c7490>
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Ff9%252F9cf93156564add7fe1ca544ba975565f%252Fpa%252FDR88922_0735142e5a56d6fe1125229e2cee99f9.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_0735142e5a56d6fe1125229e2cee99f9.jpg saved to cache
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f06aac50-c7fe-581f-89c7-06bc526592aa
2026-03-28 10:37:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f06aac50-c7fe-581f-89c7-06bc526592aa, skipping ID generation
2026-03-28 10:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 1
2026-03-28 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f06aac50-c7fe-581f-89c7-06bc526592aa sending to next pipeline
2026-03-28 10:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06aac50-c7fe-581f-89c7-06bc526592aa, identifier: DR88922
2026-03-28 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-28 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-28 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922 to the API
2026-03-28 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_0735142e5a56d6fe1125229e2cee99f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:51:00Z',
 'fuel_type': 'diesel',
 'id': 'f06aac50-c7fe-581f-89c7-06bc526592aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR88922',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 216677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ac1a5fbe8ed8d2f12a9949be9c6fe7e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_8865f5acb1901f3486517a225bdf905d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_ca87be22a86a5aed0fd158fcbd006007.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_dee2a9de5560806d06b3104ee7aa1c37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_60c95f1d42fed3744de7892acdf1f6b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_383c65ce7595f237fd09a02d7d277f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2184562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_51a250335293555ffc9dad8ac4e303fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_0735142e5a56d6fe1125229e2cee99f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_5da448178cfbf1280f974e84ad54d401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f06aac50-c7fe-581f-89c7-06bc526592aa/f06aac50-c7fe-581f-89c7-06bc526592aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/f9/9cf93156564add7fe1ca544ba975565f/pa/DR88922_135e9d9f6502065b545e7e82da6400d6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-28 10:37:31 [auto1.de] INFO: Saving data for DR88922: {'created_time': 1774694251.403192, 'last_price_update_time': 1774694251.403202, 'auction_closing_time': 1774885860.0}
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR88922') HTTP/1.1" 204 0
2026-03-28 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU16330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM27503> (referer: https://www.auto1.com/v1/car-details-view/RM27503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-28 10:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccab6dd2-bfa9-575d-b391-4d8448d6049e with scrape type 1
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ccab6dd2-bfa9-575d-b391-4d8448d6049e
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_9ac87ca307f2f302af9b044f80e62372.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_9ac87ca307f2f302af9b044f80e62372.jpg already downloaded
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_fc9732ec0dad21d3bb0b1a452aab1914.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_fc9732ec0dad21d3bb0b1a452aab1914.jpg already downloaded
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_67b56134dc125063249064f77cfcd98b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_67b56134dc125063249064f77cfcd98b.jpg already downloaded
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_71700925c9b0669690a30538a29c575c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_71700925c9b0669690a30538a29c575c.jpg already downloaded
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_4e513f86159de49751b91b00fb830572.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_4e513f86159de49751b91b00fb830572.jpg already downloaded
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F50%252Fa4500d6506333d93bff6a53b3cf93165%252Fpa%252FRM27503_d902808a0b704cb672f547c95eeb10fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_d902808a0b704cb672f547c95eeb10fc.jpg already downloaded
2026-03-28 10:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccab6dd2-bfa9-575d-b391-4d8448d6049e, identifier: RM27503
2026-03-28 10:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-28 10:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-28 10:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503 to the API
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM27503>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'diesel',
 'id': 'ccab6dd2-bfa9-575d-b391-4d8448d6049e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM27503',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 287117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_9ac87ca307f2f302af9b044f80e62372.jpg',
                'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_fc9732ec0dad21d3bb0b1a452aab1914.jpg',
                'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_67b56134dc125063249064f77cfcd98b.jpg',
                'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_71700925c9b0669690a30538a29c575c.jpg',
                'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_4e513f86159de49751b91b00fb830572.jpg',
                'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_d902808a0b704cb672f547c95eeb10fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_9ac87ca307f2f302af9b044f80e62372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_fc9732ec0dad21d3bb0b1a452aab1914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_67b56134dc125063249064f77cfcd98b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_71700925c9b0669690a30538a29c575c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_4e513f86159de49751b91b00fb830572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccab6dd2-bfa9-575d-b391-4d8448d6049e/ccab6dd2-bfa9-575d-b391-4d8448d6049e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/50/a4500d6506333d93bff6a53b3cf93165/pa/RM27503_d902808a0b704cb672f547c95eeb10fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-28 10:37:37 [auto1.de] INFO: Saving data for RM27503: {'created_time': 1774694257.068653, 'last_price_update_time': 1774694257.068665, 'auction_closing_time': 1774883227.0}
2026-03-28 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM27503') HTTP/1.1" 204 0
2026-03-28 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN43056> (referer: https://www.auto1.com/v1/car-details-view/CN43056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-28 10:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9838a0-5635-5efe-a023-88e227b78e90 with scrape type 1
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba9838a0-5635-5efe-a023-88e227b78e90
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_51171e96568236bd7cc46a2942f96d1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_51171e96568236bd7cc46a2942f96d1b.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_2e84e3f080ac87eca565e3bb3dc63a30.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_2e84e3f080ac87eca565e3bb3dc63a30.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_631af4ada76c6d841b392df70ea37abd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_631af4ada76c6d841b392df70ea37abd.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_ea94660d239b610b150175813d651c78.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_ea94660d239b610b150175813d651c78.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_308696c05959ed7dacc53f34095ad85e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_308696c05959ed7dacc53f34095ad85e.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_6f5a6362cf63878cb94282ab159a28c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_6f5a6362cf63878cb94282ab159a28c5.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_16634ce28081c6948a3033b111d5b0be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_16634ce28081c6948a3033b111d5b0be.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_1738270304e64bb9a4ba698f24e976f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_1738270304e64bb9a4ba698f24e976f4.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_afdde150d94c0f8d87ad5f2de6ea3c95.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_afdde150d94c0f8d87ad5f2de6ea3c95.jpg already downloaded
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F0e%252Fd60ea9a6babbe28bfb74451294dda1f1%252Fpa%252FCN43056_eafece14769d2f19e7fab67083d2f5c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_eafece14769d2f19e7fab67083d2f5c3.jpg already downloaded
2026-03-28 10:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9838a0-5635-5efe-a023-88e227b78e90, identifier: CN43056
2026-03-28 10:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-28 10:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-28 10:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056 to the API
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN43056>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:25Z',
 'fuel_type': 'petrol',
 'id': 'ba9838a0-5635-5efe-a023-88e227b78e90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN43056',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 128132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_51171e96568236bd7cc46a2942f96d1b.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_2e84e3f080ac87eca565e3bb3dc63a30.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_631af4ada76c6d841b392df70ea37abd.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_ea94660d239b610b150175813d651c78.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_308696c05959ed7dacc53f34095ad85e.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_6f5a6362cf63878cb94282ab159a28c5.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_16634ce28081c6948a3033b111d5b0be.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_1738270304e64bb9a4ba698f24e976f4.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_afdde150d94c0f8d87ad5f2de6ea3c95.jpg',
                'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_eafece14769d2f19e7fab67083d2f5c3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_51171e96568236bd7cc46a2942f96d1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_2e84e3f080ac87eca565e3bb3dc63a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_631af4ada76c6d841b392df70ea37abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_ea94660d239b610b150175813d651c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_308696c05959ed7dacc53f34095ad85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_6f5a6362cf63878cb94282ab159a28c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_16634ce28081c6948a3033b111d5b0be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_1738270304e64bb9a4ba698f24e976f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_afdde150d94c0f8d87ad5f2de6ea3c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9838a0-5635-5efe-a023-88e227b78e90/ba9838a0-5635-5efe-a023-88e227b78e90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/0e/d60ea9a6babbe28bfb74451294dda1f1/pa/CN43056_eafece14769d2f19e7fab67083d2f5c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2016}
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-28 10:37:42 [auto1.de] INFO: Saving data for CN43056: {'created_time': 1774694262.82587, 'last_price_update_time': 1774694262.825885, 'auction_closing_time': 1774885885.0}
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN43056') HTTP/1.1" 204 0
2026-03-28 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE10146> (referer: https://www.auto1.com/v1/car-details-view/KE10146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-28 10:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 1
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg not downloaded yet
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_2881376697be01e14a0b2e1e47fe5824.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_2881376697be01e14a0b2e1e47fe5824.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_393267aa48931c3d20083f21d0c42f75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_393267aa48931c3d20083f21d0c42f75.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_277a53c98197e224da67c5f3071a841e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_277a53c98197e224da67c5f3071a841e.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_03a565075aa24f875246bd5d3000b15f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_03a565075aa24f875246bd5d3000b15f.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_db0257906fb56453759e1d26d226e437.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_db0257906fb56453759e1d26d226e437.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_8d18af47190893eee9d425da85f6b926.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_8d18af47190893eee9d425da85f6b926.jpg not downloaded yet
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_7491e3884e5e42075bc0fe3704354e9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_7491e3884e5e42075bc0fe3704354e9c.jpg not downloaded yet
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_393267aa48931c3d20083f21d0c42f75.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_277a53c98197e224da67c5f3071a841e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg not downloaded yet
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_2881376697be01e14a0b2e1e47fe5824.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_7491e3884e5e42075bc0fe3704354e9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55680990>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_393267aa48931c3d20083f21d0c42f75.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_393267aa48931c3d20083f21d0c42f75.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f637850>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_277a53c98197e224da67c5f3071a841e.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_277a53c98197e224da67c5f3071a841e.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55658ad0>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f620190>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_2881376697be01e14a0b2e1e47fe5824.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_2881376697be01e14a0b2e1e47fe5824.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9c6e10>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e9032d0>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_7491e3884e5e42075bc0fe3704354e9c.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_7491e3884e5e42075bc0fe3704354e9c.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac7190>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_db0257906fb56453759e1d26d226e437.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_03a565075aa24f875246bd5d3000b15f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_8d18af47190893eee9d425da85f6b926.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb3e910>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_db0257906fb56453759e1d26d226e437.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_db0257906fb56453759e1d26d226e437.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecc26d0>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_03a565075aa24f875246bd5d3000b15f.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_03a565075aa24f875246bd5d3000b15f.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55680910>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9a%252F5e9a0ed3148c5bc757547fe53a8f1cd1%252Fpa%252FKE10146_8d18af47190893eee9d425da85f6b926.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_8d18af47190893eee9d425da85f6b926.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc611779-2aff-5dfd-8d68-92ca6cef7719
2026-03-28 10:37:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc611779-2aff-5dfd-8d68-92ca6cef7719, skipping ID generation
2026-03-28 10:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 1
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc611779-2aff-5dfd-8d68-92ca6cef7719 sending to next pipeline
2026-03-28 10:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc611779-2aff-5dfd-8d68-92ca6cef7719, identifier: KE10146
2026-03-28 10:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-28 10:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-28 10:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146 to the API
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_8d18af47190893eee9d425da85f6b926.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:11:52Z',
 'fuel_type': 'diesel',
 'id': 'cc611779-2aff-5dfd-8d68-92ca6cef7719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE10146',
 'listing': 'auction',
 'location': 'DE, Cham',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 221882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3438251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_10f06cbfee49aaae466fb0debb0f3ef4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3149541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_2881376697be01e14a0b2e1e47fe5824.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_393267aa48931c3d20083f21d0c42f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_277a53c98197e224da67c5f3071a841e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e35e80eb875bc18eea778b7a3630e6b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_03a565075aa24f875246bd5d3000b15f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3330227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_db0257906fb56453759e1d26d226e437.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_8d18af47190893eee9d425da85f6b926.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_7491e3884e5e42075bc0fe3704354e9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc611779-2aff-5dfd-8d68-92ca6cef7719/cc611779-2aff-5dfd-8d68-92ca6cef7719_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9a/5e9a0ed3148c5bc757547fe53a8f1cd1/pa/KE10146_e0ba0dba7880e3ce7738aac011ca6135.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-28 10:37:54 [auto1.de] INFO: Saving data for KE10146: {'created_time': 1774694274.607095, 'last_price_update_time': 1774694274.607106, 'auction_closing_time': 1774883512.0}
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE10146') HTTP/1.1" 204 0
2026-03-28 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU16330> (referer: https://www.auto1.com/v1/car-details-view/EU16330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-28 10:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with scrape type 1
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_d9841caa8eaaece68a613ca73ba095ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_d9841caa8eaaece68a613ca73ba095ea.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_6bd80cd4dc10666e3c1bc0ceafd99fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6bd80cd4dc10666e3c1bc0ceafd99fe0.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_c55e2c16d197870d1a57d3af8f450fdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_c55e2c16d197870d1a57d3af8f450fdd.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_dff13ae6c40ce828119631b1a4ebdb99.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_dff13ae6c40ce828119631b1a4ebdb99.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_6037023bf6e4ef5b798f567189187c92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6037023bf6e4ef5b798f567189187c92.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_9a67621fb9e75ff563f5a30dcfc4c406.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9a67621fb9e75ff563f5a30dcfc4c406.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_8bb2bad48cddaba1bcf5a100a700a7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_8bb2bad48cddaba1bcf5a100a700a7db.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_5563c54689fcf730d9743e74b3e50580.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5563c54689fcf730d9743e74b3e50580.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_9d9bcc6906e5fae8a6bd8f3d3e4e2444.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9d9bcc6906e5fae8a6bd8f3d3e4e2444.jpg already downloaded
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F42%252F2a42b4e9c3596be649c54d0e0fb4a24d%252Fpa%252FEU16330_5137c1bc7e46fad730d747b4740916e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5137c1bc7e46fad730d747b4740916e2.jpg already downloaded
2026-03-28 10:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b, identifier: EU16330
2026-03-28 10:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-28 10:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-28 10:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330 to the API
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EU16330>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'diesel',
 'id': 'efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU16330',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 170520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_d9841caa8eaaece68a613ca73ba095ea.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6bd80cd4dc10666e3c1bc0ceafd99fe0.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_c55e2c16d197870d1a57d3af8f450fdd.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_dff13ae6c40ce828119631b1a4ebdb99.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6037023bf6e4ef5b798f567189187c92.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9a67621fb9e75ff563f5a30dcfc4c406.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_8bb2bad48cddaba1bcf5a100a700a7db.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5563c54689fcf730d9743e74b3e50580.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9d9bcc6906e5fae8a6bd8f3d3e4e2444.jpg',
                'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5137c1bc7e46fad730d747b4740916e2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_d9841caa8eaaece68a613ca73ba095ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6bd80cd4dc10666e3c1bc0ceafd99fe0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_c55e2c16d197870d1a57d3af8f450fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_dff13ae6c40ce828119631b1a4ebdb99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_6037023bf6e4ef5b798f567189187c92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9a67621fb9e75ff563f5a30dcfc4c406.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2229410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_8bb2bad48cddaba1bcf5a100a700a7db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5563c54689fcf730d9743e74b3e50580.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_9d9bcc6906e5fae8a6bd8f3d3e4e2444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b/efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2355281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/42/2a42b4e9c3596be649c54d0e0fb4a24d/pa/EU16330_5137c1bc7e46fad730d747b4740916e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Start/Stop',
 'transmission': 'manual',
 'trim': 'Start/Stop',
 'year': 2020}
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-28 10:37:57 [auto1.de] INFO: Saving data for EU16330: {'created_time': 1774694277.94371, 'last_price_update_time': 1774694277.943724, 'auction_closing_time': 1774886196.0}
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU16330') HTTP/1.1" 204 0
2026-03-28 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM73538> (referer: https://www.auto1.com/v1/car-details-view/MM73538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-28 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0880bdfe-8678-5703-9558-41b3f6241536 with scrape type 1
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0880bdfe-8678-5703-9558-41b3f6241536
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_1bd1bfedd674a1d0898e9f0e09745448.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_1bd1bfedd674a1d0898e9f0e09745448.jpg already downloaded
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_600a7fc60d1a329e0012fc991fb11680.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_600a7fc60d1a329e0012fc991fb11680.jpg already downloaded
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_717c8ed50dd1a297989281508286b5de.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_717c8ed50dd1a297989281508286b5de.jpg already downloaded
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_7af71df0a266499e0d93fa7667760a8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_7af71df0a266499e0d93fa7667760a8f.jpg already downloaded
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_515eefb45177973a3949a2c0c053e315.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_515eefb45177973a3949a2c0c053e315.jpg already downloaded
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_3ee19d53648fa3d3ec3a6667270bdf2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_3ee19d53648fa3d3ec3a6667270bdf2e.jpg already downloaded
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_5d18a95815362fcd8d744500fe01974f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5d18a95815362fcd8d744500fe01974f.jpg already downloaded
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_0cc4d18d4efbc3bdf5f0797cad17d7c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_0cc4d18d4efbc3bdf5f0797cad17d7c1.jpg already downloaded
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_5fda9bbe8fc3a63ef653ea9f09ac2c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5fda9bbe8fc3a63ef653ea9f09ac2c73.jpg already downloaded
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fe0%252F77e0c148b0981829634e4e230f50681c%252Fpa%252FMM73538_dcfd3a553b86534d93ec8925edc73a40.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_dcfd3a553b86534d93ec8925edc73a40.jpg already downloaded
2026-03-28 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0880bdfe-8678-5703-9558-41b3f6241536, identifier: MM73538
2026-03-28 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-28 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-28 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538 to the API
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MM73538>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'diesel',
 'id': '0880bdfe-8678-5703-9558-41b3f6241536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM73538',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 272486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_1bd1bfedd674a1d0898e9f0e09745448.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_600a7fc60d1a329e0012fc991fb11680.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_717c8ed50dd1a297989281508286b5de.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_7af71df0a266499e0d93fa7667760a8f.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_515eefb45177973a3949a2c0c053e315.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_3ee19d53648fa3d3ec3a6667270bdf2e.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5d18a95815362fcd8d744500fe01974f.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_0cc4d18d4efbc3bdf5f0797cad17d7c1.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5fda9bbe8fc3a63ef653ea9f09ac2c73.jpg',
                'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_dcfd3a553b86534d93ec8925edc73a40.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_1bd1bfedd674a1d0898e9f0e09745448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_600a7fc60d1a329e0012fc991fb11680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_717c8ed50dd1a297989281508286b5de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_7af71df0a266499e0d93fa7667760a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_515eefb45177973a3949a2c0c053e315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_3ee19d53648fa3d3ec3a6667270bdf2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5d18a95815362fcd8d744500fe01974f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_0cc4d18d4efbc3bdf5f0797cad17d7c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_5fda9bbe8fc3a63ef653ea9f09ac2c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0880bdfe-8678-5703-9558-41b3f6241536/0880bdfe-8678-5703-9558-41b3f6241536_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/e0/77e0c148b0981829634e4e230f50681c/pa/MM73538_dcfd3a553b86534d93ec8925edc73a40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-10',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2011}
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [auto1.de] INFO: Saving data for MM73538: {'created_time': 1774694285.611527, 'last_price_update_time': 1774694285.611541, 'auction_closing_time': 1774884531.0}
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM73538') HTTP/1.1" 204 0
2026-03-28 10:38:06 [scrapy.extensions.logstats] INFO: Crawled 215 pages (at 14 pages/min), scraped 191 items (at 11 items/min)
2026-03-28 10:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV90594> (referer: https://www.auto1.com/v1/car-details-view/SV90594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-28 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 1
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_da1458e14b3aec737ad5f08aee90f213.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_da1458e14b3aec737ad5f08aee90f213.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_50239ff43d2436122b0fb7a221f4a044.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_50239ff43d2436122b0fb7a221f4a044.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_3014377007f637d2995337ee5acdcdb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_3014377007f637d2995337ee5acdcdb3.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_fcf97cd198348dd0b18043e37006332a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_fcf97cd198348dd0b18043e37006332a.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg not downloaded yet
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_a11e862ae7ec338e72ee6638b9002722.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_a11e862ae7ec338e72ee6638b9002722.jpg not downloaded yet
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_8ea8b3d49169515f4ef02995f74f805c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_8ea8b3d49169515f4ef02995f74f805c.jpg not downloaded yet
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea4d9d0>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_da1458e14b3aec737ad5f08aee90f213.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_8ea8b3d49169515f4ef02995f74f805c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_50239ff43d2436122b0fb7a221f4a044.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_3014377007f637d2995337ee5acdcdb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_fcf97cd198348dd0b18043e37006332a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb5be50>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_da1458e14b3aec737ad5f08aee90f213.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_da1458e14b3aec737ad5f08aee90f213.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_a11e862ae7ec338e72ee6638b9002722.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea2b6d0>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_8ea8b3d49169515f4ef02995f74f805c.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_8ea8b3d49169515f4ef02995f74f805c.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e984650>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_50239ff43d2436122b0fb7a221f4a044.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_50239ff43d2436122b0fb7a221f4a044.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f779590>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecf7950>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_3014377007f637d2995337ee5acdcdb3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_3014377007f637d2995337ee5acdcdb3.jpg saved to cache
2026-03-28 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e976f10>
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_fcf97cd198348dd0b18043e37006332a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_fcf97cd198348dd0b18043e37006332a.jpg saved to cache
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e92fe90>
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg saved to cache
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac5750>
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg saved to cache
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e977850>
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F7f%252F047fa720b92f572327b5bea9eea97059%252Fpa%252FSV90594_a11e862ae7ec338e72ee6638b9002722.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_a11e862ae7ec338e72ee6638b9002722.jpg saved to cache
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a47f807-665f-57f6-8259-b646dbe17ecc
2026-03-28 10:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a47f807-665f-57f6-8259-b646dbe17ecc, skipping ID generation
2026-03-28 10:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 1
2026-03-28 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a47f807-665f-57f6-8259-b646dbe17ecc sending to next pipeline
2026-03-28 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a47f807-665f-57f6-8259-b646dbe17ecc, identifier: SV90594
2026-03-28 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-28 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-28 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594 to the API
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_a11e862ae7ec338e72ee6638b9002722.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:53:32Z',
 'fuel_type': 'petrol',
 'id': '7a47f807-665f-57f6-8259-b646dbe17ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV90594',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 191114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_e5b7a278029d5e6c4a3cb29a5e2ab0c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_da1458e14b3aec737ad5f08aee90f213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_50239ff43d2436122b0fb7a221f4a044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_4fe369a4cf50e12746ec8a6dfb530e5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_3014377007f637d2995337ee5acdcdb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_d092a3a70b8ad7ac528234cb8d2114df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_fcf97cd198348dd0b18043e37006332a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_f2dff0b749ef0ce2b68a751657a30e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_a11e862ae7ec338e72ee6638b9002722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a47f807-665f-57f6-8259-b646dbe17ecc/7a47f807-665f-57f6-8259-b646dbe17ecc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/7f/047fa720b92f572327b5bea9eea97059/pa/SV90594_8ea8b3d49169515f4ef02995f74f805c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Smart forfour 1.3 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2005}
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-28 10:38:10 [auto1.de] INFO: Saving data for SV90594: {'created_time': 1774694290.604188, 'last_price_update_time': 1774694290.604199, 'auction_closing_time': 1774886012.0}
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV90594') HTTP/1.1" 204 0
2026-03-28 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE20907> (referer: https://www.auto1.com/v1/car-details-view/KE20907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-28 10:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 1
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_438c86a67865a02f01800b8a919d0f9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_438c86a67865a02f01800b8a919d0f9f.jpg not downloaded yet
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg not downloaded yet
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_323e8a5590e7d14dadd0c3534aca5921.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_323e8a5590e7d14dadd0c3534aca5921.jpg not downloaded yet
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg not downloaded yet
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_fa55a054ce1362b3f3058e400effa8ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_fa55a054ce1362b3f3058e400effa8ca.jpg not downloaded yet
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_d2c1a642dc2dbb82801c905247e868c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_d2c1a642dc2dbb82801c905247e868c3.jpg not downloaded yet
2026-03-28 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_438c86a67865a02f01800b8a919d0f9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg not downloaded yet
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_49095eaedbd41be4c1d83217ff401572.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_49095eaedbd41be4c1d83217ff401572.jpg not downloaded yet
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_4dd1ac766101f2caac51e5e4988e817e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_4dd1ac766101f2caac51e5e4988e817e.jpg not downloaded yet
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_d2c1a642dc2dbb82801c905247e868c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_2e419e198fd0d71d68c099e08beace69.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_2e419e198fd0d71d68c099e08beace69.jpg not downloaded yet
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5f1010>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_438c86a67865a02f01800b8a919d0f9f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_438c86a67865a02f01800b8a919d0f9f.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_323e8a5590e7d14dadd0c3534aca5921.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_2e419e198fd0d71d68c099e08beace69.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_fa55a054ce1362b3f3058e400effa8ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_4dd1ac766101f2caac51e5e4988e817e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55639990>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_49095eaedbd41be4c1d83217ff401572.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ead99d0>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_d2c1a642dc2dbb82801c905247e868c3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_d2c1a642dc2dbb82801c905247e868c3.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd5568aad0>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb288d0>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_323e8a5590e7d14dadd0c3534aca5921.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_323e8a5590e7d14dadd0c3534aca5921.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5e3310>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_2e419e198fd0d71d68c099e08beace69.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_2e419e198fd0d71d68c099e08beace69.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ebc9590>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_fa55a054ce1362b3f3058e400effa8ca.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_fa55a054ce1362b3f3058e400effa8ca.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd55681050>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_4dd1ac766101f2caac51e5e4988e817e.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_4dd1ac766101f2caac51e5e4988e817e.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd544e5d10>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea72d90>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F6e%252F136ee0ae0a71ce8bd33493e6ba3d06e8%252Fpa%252FKE20907_49095eaedbd41be4c1d83217ff401572.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_49095eaedbd41be4c1d83217ff401572.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 030a247d-f685-53c6-abd3-6e27a13efc2e
2026-03-28 10:38:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 030a247d-f685-53c6-abd3-6e27a13efc2e, skipping ID generation
2026-03-28 10:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 1
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 030a247d-f685-53c6-abd3-6e27a13efc2e sending to next pipeline
2026-03-28 10:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 030a247d-f685-53c6-abd3-6e27a13efc2e, identifier: KE20907
2026-03-28 10:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-28 10:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-28 10:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907 to the API
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_49095eaedbd41be4c1d83217ff401572.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '030a247d-f685-53c6-abd3-6e27a13efc2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE20907',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 129421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_438c86a67865a02f01800b8a919d0f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319991,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_5dfb2c66c9a221eeaabc8a68f3f574c5.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_323e8a5590e7d14dadd0c3534aca5921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_04c45dbf2a9ef7e69205436cafe872ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290393,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_fa55a054ce1362b3f3058e400effa8ca.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_d2c1a642dc2dbb82801c905247e868c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_a6facfea55fb8fcbdeed63d8e6223ddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_49095eaedbd41be4c1d83217ff401572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295371,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_4dd1ac766101f2caac51e5e4988e817e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030a247d-f685-53c6-abd3-6e27a13efc2e/030a247d-f685-53c6-abd3-6e27a13efc2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/6e/136ee0ae0a71ce8bd33493e6ba3d06e8/pa/KE20907_2e419e198fd0d71d68c099e08beace69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [auto1.de] INFO: Saving data for KE20907: {'created_time': 1774694321.230602, 'last_price_update_time': 1774694321.230619, 'auction_closing_time': 1774886296.0}
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE20907') HTTP/1.1" 204 0
2026-03-28 10:39:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.623(s), this was the 1st time calling it.
2026-03-28 10:39:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.44675153291842 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:06 [scrapy.extensions.logstats] INFO: Crawled 217 pages (at 2 pages/min), scraped 193 items (at 2 items/min)
2026-03-28 10:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.059(s), this was the 1st time calling it.
2026-03-28 10:39:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.747473919202121 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:20 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9638 | hits on page: 40
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: PC15308
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL55918%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for XL55918: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: NV14001
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV14001%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for NV14001: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45591%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for DB45591: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG34778%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for LG34778: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: GP45191
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45191%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for GP45191: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: CB43306
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51381%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for AA51381: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL74315%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for JL74315: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: UF03548
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03548%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for UF03548: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-28 10:39:20 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 10:39:20 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: XL09941
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL09941%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for XL09941: 0
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: GR29564
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR29564%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for GR29564: 0
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: PG01901
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG01901%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for PG01901: 0
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: XB18292
2026-03-28 10:39:21 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 10:39:21 [auto1.de] INFO: Scrape type for XB21556: 0
2026-03-28 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:22 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9639 | hits on page: 40
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for XB21556: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: VH56486
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH56486%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for VH56486: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: YL20431
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL20431%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for YL20431: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: TY55023
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55023%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for TY55023: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: KR71178
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: PK60768
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: FK75470
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK75470%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for FK75470: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: ZA94755
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE06188%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for EE06188: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-28 10:39:22 [auto1.de] INFO: Found listing with ID: BM57132
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM57132%27 HTTP/1.1" 200 None
2026-03-28 10:39:22 [auto1.de] INFO: Scrape type for BM57132: 0
2026-03-28 10:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:23 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9639 | hits on page: 40
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: LF00683
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00683%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for LF00683: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: LU01716
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: ES71771
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES71771%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for ES71771: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BL23866
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: LW02583
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: BC73900
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73900%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for BC73900: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-28 10:39:23 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-28 10:39:23 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 10:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:26 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9640 | hits on page: 40
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: CF34401
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: TJ50695
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: JB03080
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03080%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for JB03080: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK84754%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for UK84754: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: BX84490
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: WN78953
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: US80422
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80422%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for US80422: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: PT81220
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT81220%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for PT81220: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-28 10:39:26 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-28 10:39:26 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 10:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL77757> (referer: https://www.auto1.com/v1/car-details-view/EL77757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-28 10:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 1
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_d7c998f613c08417ca21aacb03afb542.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_d7c998f613c08417ca21aacb03afb542.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_8c36f77793c958209204858d8284ebf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8c36f77793c958209204858d8284ebf1.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg not downloaded yet
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_28a2eb9fe62816797809827340061759.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_28a2eb9fe62816797809827340061759.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_7870986c7464077cde5bbafd667f05d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_7870986c7464077cde5bbafd667f05d8.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_1ecdbf01871db7b76286e473e0f71321.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_1ecdbf01871db7b76286e473e0f71321.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_734579e3faa10298f292cdb0a9643f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_734579e3faa10298f292cdb0a9643f43.jpg not downloaded yet
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_044dc3ba610a35a29597719a660eced2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_044dc3ba610a35a29597719a660eced2.jpg not downloaded yet
2026-03-28 10:39:28 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9640 | hits on page: 40
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: TE23487
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE23487%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for TE23487: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ23427%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for PJ23427: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: TC10738
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-28 10:39:28 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-28 10:39:28 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 10:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_7870986c7464077cde5bbafd667f05d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_1ecdbf01871db7b76286e473e0f71321.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_d7c998f613c08417ca21aacb03afb542.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8c36f77793c958209204858d8284ebf1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_28a2eb9fe62816797809827340061759.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ea73b90>
2026-03-28 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f5718d0>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_7870986c7464077cde5bbafd667f05d8.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_7870986c7464077cde5bbafd667f05d8.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_044dc3ba610a35a29597719a660eced2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_734579e3faa10298f292cdb0a9643f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eac52d0>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_1ecdbf01871db7b76286e473e0f71321.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_1ecdbf01871db7b76286e473e0f71321.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4f56d1d0>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_d7c998f613c08417ca21aacb03afb542.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_d7c998f613c08417ca21aacb03afb542.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e976090>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_8c36f77793c958209204858d8284ebf1.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8c36f77793c958209204858d8284ebf1.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e901a50>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecc0f90>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_28a2eb9fe62816797809827340061759.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_28a2eb9fe62816797809827340061759.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4ecd5cd0>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4e914190>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_044dc3ba610a35a29597719a660eced2.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_044dc3ba610a35a29597719a660eced2.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdd4eb4d0d0>
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fca%252F3cca477b067d4175416629cb76daebec%252Fpa%252FEL77757_734579e3faa10298f292cdb0a9643f43.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_734579e3faa10298f292cdb0a9643f43.jpg saved to cache
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e18c4836-9a86-536e-906e-bf9f269c6ff1
2026-03-28 10:39:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e18c4836-9a86-536e-906e-bf9f269c6ff1, skipping ID generation
2026-03-28 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 1
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e18c4836-9a86-536e-906e-bf9f269c6ff1 sending to next pipeline
2026-03-28 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e18c4836-9a86-536e-906e-bf9f269c6ff1, identifier: EL77757
2026-03-28 10:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-28 10:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-28 10:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757 to the API
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_734579e3faa10298f292cdb0a9643f43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': 'e18c4836-9a86-536e-906e-bf9f269c6ff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL77757',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 124617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2962839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_d7c998f613c08417ca21aacb03afb542.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3242947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8c36f77793c958209204858d8284ebf1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_c995f5f08ea7669dac6b1c6194cf7211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3155823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_8651caf4b2f7cf4fccb1b4ea7f99773e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_6eced6ffc799bfb743d3591f3f4a3bd8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_28a2eb9fe62816797809827340061759.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_7870986c7464077cde5bbafd667f05d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_1ecdbf01871db7b76286e473e0f71321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_734579e3faa10298f292cdb0a9643f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18c4836-9a86-536e-906e-bf9f269c6ff1/e18c4836-9a86-536e-906e-bf9f269c6ff1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ca/3cca477b067d4175416629cb76daebec/pa/EL77757_044dc3ba610a35a29597719a660eced2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.8 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [auto1.de] INFO: Saving data for EL77757: {'created_time': 1774694370.730648, 'last_price_update_time': 1774694370.730662, 'auction_closing_time': 1774886090.0}
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL77757') HTTP/1.1" 204 0
2026-03-28 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:36 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9640 | hits on page: 40
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: RB39093
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: FX57031
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: MF29481
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF29481%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for MF29481: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: GE07622
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE07622%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for GE07622: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: YB13434
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: DN72961
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: AB20934
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB20934%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for AB20934: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: FX68518
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX68518%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for FX68518: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: JF90132
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF90132%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for JF90132: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: CU59576
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 10:39:36 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-28 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:40 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9640 | hits on page: 40
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: LJ89575
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ89575%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for LJ89575: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: MX06399
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: XX93407
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: SE90134
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90134%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for SE90134: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: GN38725
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: LZ73425
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ73425%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for LZ73425: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: PV39921
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: UM40776
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: PR48691
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR48691%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for PR48691: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: BX52311
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: HF45615
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: TE36715
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE36715%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for TE36715: 0
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 10:39:40 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN06513%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Scrape type for KN06513: 0
2026-03-28 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:49 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9641 | hits on page: 40
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN06513%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for KN06513: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: EX28790
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: GE34935
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: LK84028
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK84028%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for LK84028: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: FV70322
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV70322%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for FV70322: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: RG19382
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19382%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for RG19382: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: JB27524
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB27524%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for JB27524: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV44550%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for DV44550: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for RT03172: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: MN73743
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN73743%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for MN73743: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: XG23027
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG23027%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for XG23027: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: UV23463
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: KX75586
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX75586%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for KX75586: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: AZ36706
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ36706%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for AZ36706: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: CC17090
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC17090%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for CC17090: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK28110%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for TK28110: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Scrape type for TB76582: 0
2026-03-28 10:39:49 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-28 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:50 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9641 | hits on page: 40
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR17987%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for YR17987: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP12024%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for ZP12024: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG90812%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for HG90812: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT59384%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [auto1.de] INFO: Scrape type for ZT59384: 0
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-28 10:39:50 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY20785%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for PY20785: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF92899%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for NF92899: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR03483%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for YR03483: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29322%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for VK29322: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: JE79416
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79416%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for JE79416: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ40039%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for MJ40039: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA03133%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for XA03133: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Scrape type for FJ62780: 0
2026-03-28 10:39:51 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-28 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:53 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9641 | hits on page: 40
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW16668%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for RW16668: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ53793%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for NZ53793: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV92310%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for GV92310: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC51546%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for UC51546: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV63188%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for NV63188: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW22563%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for BW22563: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH92359%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for CH92359: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP44882%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for VP44882: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU27308%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for PU27308: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for JE92990: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV63025%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for WV63025: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW24668%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for CW24668: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL13353%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for DL13353: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA94395%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for MA94395: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ91789%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for GZ91789: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE14279%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for XE14279: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71655%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for GF71655: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ12668%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [auto1.de] INFO: Scrape type for WZ12668: 0
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-28 10:39:53 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 10:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:01 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: UM61936
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47417%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for AM47417: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: UG86555
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS50452%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for BS50452: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD72248%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for UD72248: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE63611%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for CE63611: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: NE03141
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB62931%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for BB62931: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA88273%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for CA88273: 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04529%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for ZN04529: 0
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:06 [scrapy.extensions.logstats] INFO: Crawled 229 pages (at 12 pages/min), scraped 194 items (at 1 items/min)
2026-03-28 10:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:36 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM94296%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for JM94296: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH88126%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for NH88126: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24759%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for KX24759: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for LD36602: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for BE30085: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: FH28762
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF50389%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for GF50389: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV06251%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for CV06251: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK69314%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for NK69314: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP32297%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for EP32297: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD38415%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for DD38415: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for JS17929: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC83870%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for EC83870: 0
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD48176%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for FD48176: 0
2026-03-28 10:40:37 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Scrape type for GH78103: 0
2026-03-28 10:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:39 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9642 | hits on page: 40
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for GH78103: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF06916%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for LF06916: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK98649%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for BK98649: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW88282%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for EW88282: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for VN21885: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB50731%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for PB50731: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-28 10:40:39 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-28 10:40:39 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-28 10:40:40 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH85381%27 HTTP/1.1" 200 None
2026-03-28 10:40:40 [auto1.de] INFO: Scrape type for MH85381: 0
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT55034%27 HTTP/1.1" 200 None
2026-03-28 10:40:40 [auto1.de] INFO: Scrape type for AT55034: 0
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-28 10:40:40 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 10:40:40 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54013%27 HTTP/1.1" 200 None
2026-03-28 10:40:40 [auto1.de] INFO: Scrape type for HY54013: 0
2026-03-28 10:40:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:44 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9642 | hits on page: 40
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD57756%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for FD57756: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY40149%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for PY40149: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL36324%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for DL36324: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK08384%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for RK08384: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX74637%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for JX74637: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH26074%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for MH26074: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR13115%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for LR13115: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL27476%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for XL27476: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11262%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for ZN11262: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE37210%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for ZE37210: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA31743%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for XA31743: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS93461%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for BS93461: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA88667%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [auto1.de] INFO: Scrape type for JA88667: 0
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-28 10:40:44 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-28 10:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:46 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9642 | hits on page: 40
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL10469%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for VL10469: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ55342%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for WZ55342: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ70051%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for NJ70051: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33962%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for GN33962: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH37782%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for CH37782: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH10598%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for TH10598: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL02035%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for AL02035: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ32312%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for KJ32312: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT20350%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for BT20350: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV15766%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for TV15766: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for JT25631: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for VT28358: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 10:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:52 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for BH50029: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for JA95391: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU08613%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for PU08613: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS79921%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for DS79921: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM33158%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for YM33158: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ03470%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for JZ03470: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: YV00461
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for RP49857: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE28100%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for PE28100: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK88331%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for LK88331: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95241%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for MH95241: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: DX81242
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX81242%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Scrape type for DX81242: 0
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-28 10:40:53 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-28 10:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:54 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06608%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for PG06608: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC01881%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for CC01881: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: US98158
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US98158%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for US98158: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX80513%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for MX80513: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA23374%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for KA23374: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR02271%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for NR02271: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT69264%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for KT69264: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46428%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for GZ46428: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-28 10:40:54 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU46856%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Scrape type for VU46856: 0
2026-03-28 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:55 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for JG32595: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK54006%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for WK54006: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG17915%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for VG17915: 0
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-28 10:40:55 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG12940%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Scrape type for EG12940: 2
2026-03-28 10:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fccde63-26be-50ab-a539-d606dc17941b with identifier: EG12940
2026-03-28 10:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fccde63-26be-50ab-a539-d606dc17941b with scrape type 2
2026-03-28 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fccde63-26be-50ab-a539-d606dc17941b with scrape type 2
2026-03-28 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fccde63-26be-50ab-a539-d606dc17941b, identifier: EG12940
2026-03-28 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fccde63-26be-50ab-a539-d606dc17941b with identifier: EG12940
2026-03-28 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fccde63-26be-50ab-a539-d606dc17941b with identifier: EG12940
2026-03-28 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fccde63-26be-50ab-a539-d606dc17941b with identifier: EG12940 to the API
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:30Z',
 'fuel_type': 'diesel',
 'id': '3fccde63-26be-50ab-a539-d606dc17941b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG12940',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 198536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG12940%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Saving data for EG12940: {'auction_closing_time': 1774715970.0, 'created_time': 1772545232.408412, 'last_price_update_time': 1774694456.344005}
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG12940') HTTP/1.1" 204 0
2026-03-28 10:40:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: TZ50604
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX27115%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for TX27115: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for SF00681: 2
2026-03-28 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-28 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with scrape type 2
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with scrape type 2
2026-03-28 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00, identifier: SF00681
2026-03-28 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-28 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-28 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681 to the API
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:51:57Z',
 'fuel_type': 'petrol',
 'id': '64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF00681',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 120842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Saving data for SF00681: {'auction_closing_time': 1774716717.0, 'created_time': 1774510246.907236, 'last_price_update_time': 1774694457.133115}
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF00681') HTTP/1.1" 204 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT79910%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for UT79910: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN31553%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for AN31553: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70862%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for FC70862: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL01890%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Scrape type for WL01890: 0
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-28 10:40:57 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:59 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for KY88001: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU66338%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for BU66338: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK08772%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for YK08772: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for PY30467: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02743%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for GD02743: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for FP43907: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW50887%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for JW50887: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV12597%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for NV12597: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for MW79572: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF88904%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for VF88904: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY82766%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for KY82766: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for CW57830: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP36932%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for TP36932: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-28 10:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:00 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9643 | hits on page: 40
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT11627%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for XT11627: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for AT18561: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88809%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for PV88809: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ91552%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for WZ91552: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA55344%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for TA55344: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH13590%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for VH13590: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA33826%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for LA33826: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA93370%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for KA93370: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for SY11471: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU32339%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for YU32339: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for GL86487: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN44984%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Scrape type for TN44984: 0
2026-03-28 10:41:00 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY69766%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for SY69766: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC12091%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for VC12091: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN27316%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for HN27316: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for LW48006: 2
2026-03-28 10:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-28 10:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be57fe57-1e38-5e4b-b705-2522a61a118c with scrape type 2
2026-03-28 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be57fe57-1e38-5e4b-b705-2522a61a118c with scrape type 2
2026-03-28 10:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be57fe57-1e38-5e4b-b705-2522a61a118c, identifier: LW48006
2026-03-28 10:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-28 10:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-28 10:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006 to the API
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:39:45Z',
 'fuel_type': 'hybrid',
 'id': 'be57fe57-1e38-5e4b-b705-2522a61a118c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW48006',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 128424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': None,
 'title': 'BMW 5er 530e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2022}
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Saving data for LW48006: {'auction_closing_time': 1774715985.0, 'created_time': 1774510239.333895, 'last_price_update_time': 1774694461.728737}
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW48006') HTTP/1.1" 204 0
2026-03-28 10:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91668%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for HP91668: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: RG80046
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG80046%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for RG80046: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 10:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:02 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP39257%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for WP39257: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31818%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for SY31818: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ21826%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for ZZ21826: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE65319%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for YE65319: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC40385%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for DC40385: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52158%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for ZM52158: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT13824%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for AT13824: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE73867%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for BE73867: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46015%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for LC46015: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ57220%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for RJ57220: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for KZ90725: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB61549%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for LB61549: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM69109%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for XM69109: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: NU93751
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU93751%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for NU93751: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW58482%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for RW58482: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-28 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:04 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for WJ57335: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46139%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for CM46139: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03254%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for TB03254: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for HG55526: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ42588%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for EZ42588: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP66514%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for XP66514: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV43751%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for PV43751: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ32388%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for BZ32388: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR87963%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for GR87963: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ89922%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for WZ89922: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT28544%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for CT28544: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for ZZ22411: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM57263%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for AM57263: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN29778%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for SN29778: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY31029%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for FY31029: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62557%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for NW62557: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: VE56470
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE56470%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for VE56470: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-28 10:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:06 [scrapy.extensions.logstats] INFO: Crawled 240 pages (at 11 pages/min), scraped 197 items (at 3 items/min)
2026-03-28 10:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:07 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9643 | hits on page: 40
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT17472%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for FT17472: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT91043%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for AT91043: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: XU94698
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU94698%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for XU94698: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX14113%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for TX14113: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68643%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for HU68643: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18640%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for SV18640: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM76659%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for XM76659: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB57730%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for WB57730: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: TD78857
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for BK48500: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: TA30581
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES90262%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for ES90262: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG51970%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for KG51970: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76696%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for RT76696: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK52215%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for PK52215: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV40404%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for SV40404: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for EL91919: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR88631%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for ZR88631: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD17341%27 HTTP/1.1" 200 None
2026-03-28 10:41:07 [auto1.de] INFO: Scrape type for AD17341: 0
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-28 10:41:07 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 10:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:09 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR29667%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for ZR29667: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: CR46932
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR46932%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for CR46932: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU75801%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for SU75801: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20849%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for HZ20849: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY59388%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for TY59388: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL38814%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for WL38814: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB85730%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for TB85730: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV62797%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for UV62797: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY16497%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for KY16497: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98578%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for KG98578: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07477%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for PY07477: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ59156%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for CZ59156: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG39570%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for NG39570: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE61416%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for DE61416: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-28 10:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:11 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for DA75370: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS83554%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for YS83554: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for MU75641: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD07128%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for SD07128: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM98410%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for MM98410: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS29449%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for NS29449: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK50134%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for WK50134: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59157%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for WA59157: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for TH25711: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX91307%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for LX91307: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-28 10:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:16 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for RN76659: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL28504%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for TL28504: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE71450%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for NE71450: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK54144%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for JK54144: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for LU41152: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for YL58691: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY08427%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for HY08427: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN50976%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for AN50976: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22975%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for WR22975: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH65641%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for SH65641: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59950%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for UA59950: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30442%27 HTTP/1.1" 200 None
2026-03-28 10:41:16 [auto1.de] INFO: Scrape type for GC30442: 0
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 10:41:16 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 10:41:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:17 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN43216%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for AN43216: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for XD99934: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD42859%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for SD42859: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT99201%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for VT99201: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS89246%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for PS89246: 0
2026-03-28 10:41:17 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD38705%27 HTTP/1.1" 200 None
2026-03-28 10:41:17 [auto1.de] INFO: Scrape type for XD38705: 0
2026-03-28 10:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:18 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC05152%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for KC05152: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH45156%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for GH45156: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for YU65678: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP00129%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for ZP00129: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD42447%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for AD42447: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP28896%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for CP28896: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for PY66131: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for LW90225: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for RW76455: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-28 10:41:19 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-28 10:41:19 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-28 10:41:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:20 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS64258%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for MS64258: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP46996%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for TP46996: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK23764%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for AK23764: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39834%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for ST39834: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93551%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for RF93551: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50693%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for XV50693: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM54367%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for DM54367: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for WU48136: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20258%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for PX20258: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19739%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for RT19739: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL76868%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for RL76868: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-28 10:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:22 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for MA62044: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for SU53309: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for CS95663: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for LT67236: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA83352%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for PA83352: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX36804%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for PX36804: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for PW66424: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF30543%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for VF30543: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM41381%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for MM41381: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69912%27 HTTP/1.1" 200 None
2026-03-28 10:41:22 [auto1.de] INFO: Scrape type for JD69912: 0
2026-03-28 10:41:22 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-28 10:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:23 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10709%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for DH10709: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96616%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for KF96616: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for EZ29207: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ30359%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for AJ30359: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR49421%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for FR49421: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09171%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for KV09171: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD70128%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for RD70128: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AN49564
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for SV38598: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09015%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for XJ09015: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73485%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for ZC73485: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ37968%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for HZ37968: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB21758%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for AB21758: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX42379%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for EX42379: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42174%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for MN42174: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV59132%27 HTTP/1.1" 200 None
2026-03-28 10:41:23 [auto1.de] INFO: Scrape type for AV59132: 0
2026-03-28 10:41:23 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-28 10:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:25 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT94381%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for NT94381: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72775%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for CK72775: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN98514%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for YN98514: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ27432%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for AZ27432: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ54460%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for FZ54460: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for KK55590: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: NC47913
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC47913%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for NC47913: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for FC08101: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK18909%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for CK18909: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW83643%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for WW83643: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU32442%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for FU32442: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP04846%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for HP04846: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA48353%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for SA48353: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for ET75266: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX64853%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for YX64853: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB19149%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for NB19149: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM18841%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for NM18841: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH78199%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for FH78199: 0
2026-03-28 10:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:26 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG85198%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for NG85198: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC45709%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for ZC45709: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL42149%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for ZL42149: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54193%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for AB54193: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN39214%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for AN39214: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-28 10:41:26 [auto1.de] INFO: Scrape type for LW16241: 0
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE50023%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for HE50023: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD57497%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for WD57497: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ77836%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for NZ77836: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH08953%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for RH08953: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS00518%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for KS00518: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09067%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for TS09067: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES63389%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for ES63389: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH15635%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for SH15635: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XJ09013
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09013%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for XJ09013: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX06871%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for HX06871: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62941%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for BJ62941: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR46884%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for ZR46884: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP80343%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for YP80343: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 10:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:29 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9645 | hits on page: 40
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04354%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for TH04354: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR64740%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for JR64740: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX27196%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for UX27196: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94755%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for SM94755: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM34765%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for LM34765: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45609%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for DC45609: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07385%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for FK07385: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ58005%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for ZJ58005: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for SE64605: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58428%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for FJ58428: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76410%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for CS76410: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-28 10:41:29 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-28 10:41:29 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-28 10:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:46 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9645 | hits on page: 40
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for EN59108: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for ZV14288: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29139%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for VK29139: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR80817%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for CR80817: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-28 10:41:46 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77956%27 HTTP/1.1" 200 None
2026-03-28 10:41:46 [auto1.de] INFO: Scrape type for TY77956: 0
2026-03-28 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:50 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9646 | hits on page: 40
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77956%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for TY77956: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG84867%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for EG84867: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for HY62017: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-28 10:41:50 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-28 10:41:50 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-28 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN85060%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for NN85060: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG82326%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for WG82326: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50854%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for SB50854: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC70183%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for JC70183: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS56575%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for WS56575: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08306%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for XT08306: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92579%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for LS92579: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD32766%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for AD32766: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ41827%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for RJ41827: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH60913%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for KH60913: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08040%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for GC08040: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP92353%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for VP92353: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for AC60710: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG79095%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for GG79095: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV46118%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for ZV46118: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-28 10:41:51 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: XJ72982
2026-03-28 10:41:51 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 10:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:06 [scrapy.extensions.logstats] INFO: Crawled 254 pages (at 14 pages/min), scraped 197 items (at 0 items/min)
2026-03-28 10:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:28 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:28 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 10:42:28 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-28 10:42:28 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 10:42:28 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 10:42:28 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS99660%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for RS99660: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP56505%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for KP56505: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL26666%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for JL26666: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL43539%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for AL43539: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW46423%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for RW46423: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE78828%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for RE78828: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE53774%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for YE53774: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60140%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for SL60140: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC15993%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for RC15993: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90345%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for NF90345: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21254%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for NR21254: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR74650%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for GR74650: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-28 10:42:29 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-28 10:42:29 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-28 10:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:33 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR78378%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for NR78378: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for MR59336: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for KT31788: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for PV86472: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61173%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for ZU61173: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: NP44902
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP44902%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for NP44902: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX06727%27 HTTP/1.1" 200 None
2026-03-28 10:42:33 [auto1.de] INFO: Scrape type for UX06727: 0
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-28 10:42:33 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB02068%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for DB02068: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90837%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for DN90837: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86459%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for DC86459: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87234%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for GX87234: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD35505%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for FD35505: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC62471%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for AC62471: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR49435%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for HR49435: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-28 10:42:34 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-28 10:42:34 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-28 10:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:36 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21329%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for NF21329: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77365%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for ZJ77365: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55666%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for GB55666: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96268%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for NY96268: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM56295%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for VM56295: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR66654%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for RR66654: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM54102%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for PM54102: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94573%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for GE94573: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ26847%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for KJ26847: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN17735%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for AN17735: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT80939%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for JT80939: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK06166%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for AK06166: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for RD74576: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN88175%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for KN88175: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC82989%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for LC82989: 0
2026-03-28 10:42:36 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL83760%27 HTTP/1.1" 200 None
2026-03-28 10:42:36 [auto1.de] INFO: Scrape type for DL83760: 0
2026-03-28 10:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:46 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK16260%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for VK16260: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT22490%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for NT22490: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX04970%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for ZX04970: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN35431%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for KN35431: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24086%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for DL24086: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for PJ28903: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ13626%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for XJ13626: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR93470%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for CR93470: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98108%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for FK98108: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS87471%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for YS87471: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ76475%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for EJ76475: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE71423%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for XE71423: 0
2026-03-28 10:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:51 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9649 | hits on page: 40
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE71423%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for XE71423: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for SG45173: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY28505%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for AY28505: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT95105%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for WT95105: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA35826%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for KA35826: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN29221%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for RN29221: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for JW40764: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: LM46522
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46522%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for LM46522: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN88329%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for YN88329: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08307%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for SX08307: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55447%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for WW55447: 0
2026-03-28 10:42:51 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ15035%27 HTTP/1.1" 200 None
2026-03-28 10:42:51 [auto1.de] INFO: Scrape type for XJ15035: 0
2026-03-28 10:42:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:06 [scrapy.extensions.logstats] INFO: Crawled 259 pages (at 5 pages/min), scraped 197 items (at 0 items/min)
2026-03-28 10:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:10 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ15035%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for XJ15035: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50341%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for GN50341: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH14540%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for XH14540: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: CL78510
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03153%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for MH03153: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL02084%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for RL02084: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG25746%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for ZG25746: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA71788%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for TA71788: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for CG53828: 2
2026-03-28 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-28 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197ab80b-7653-51b6-8eba-5e39043d2371 with scrape type 2
2026-03-28 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197ab80b-7653-51b6-8eba-5e39043d2371 with scrape type 2
2026-03-28 10:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 197ab80b-7653-51b6-8eba-5e39043d2371, identifier: CG53828
2026-03-28 10:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-28 10:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-28 10:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828 to the API
2026-03-28 10:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:08:22Z',
 'fuel_type': 'petrol',
 'id': '197ab80b-7653-51b6-8eba-5e39043d2371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG53828',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 197331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Saving data for CG53828: {'auction_closing_time': 1774714102.0, 'created_time': 1774510238.835104, 'last_price_update_time': 1774694592.611862}
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG53828') HTTP/1.1" 204 0
2026-03-28 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR71281%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for VR71281: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN87515%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for FN87515: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX25953%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for WX25953: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL49502%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for RL49502: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for MK13186: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for AH51648: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-28 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:13 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD07127%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for ZD07127: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW40680%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for HW40680: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY97768%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for BY97768: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB98859%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for UB98859: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB75703%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for NB75703: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65536%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for RY65536: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK31423%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for TK31423: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN66331%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for CN66331: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR50139%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for XR50139: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86337%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for JJ86337: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: LD43960
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-28 10:43:14 [auto1.de] INFO: Scrape type for EW55752: 0
2026-03-28 10:43:14 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-28 10:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:16 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF30152%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for RF30152: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS59678%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for ZS59678: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC92529%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for NC92529: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for KP41876: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF37274%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for EF37274: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG91640%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for KG91640: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for VA30007: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19344%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for RG19344: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:18 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY70112%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for GY70112: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP56741%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for LP56741: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: BG54710
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG54710%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for BG54710: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF10797%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for YF10797: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX88052%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for VX88052: 0
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-28 10:43:18 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW70204%27 HTTP/1.1" 200 None
2026-03-28 10:43:18 [auto1.de] INFO: Scrape type for YW70204: 2
2026-03-28 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663274a8-3f49-584c-95a5-3c99003c769f with identifier: YW70204
2026-03-28 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663274a8-3f49-584c-95a5-3c99003c769f with scrape type 2
2026-03-28 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 663274a8-3f49-584c-95a5-3c99003c769f with scrape type 2
2026-03-28 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 663274a8-3f49-584c-95a5-3c99003c769f, identifier: YW70204
2026-03-28 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 663274a8-3f49-584c-95a5-3c99003c769f with identifier: YW70204
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 663274a8-3f49-584c-95a5-3c99003c769f with identifier: YW70204
2026-03-28 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 663274a8-3f49-584c-95a5-3c99003c769f with identifier: YW70204 to the API
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:28:49Z',
 'fuel_type': 'petrol',
 'id': '663274a8-3f49-584c-95a5-3c99003c769f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW70204',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 189981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2005}
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW70204%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Saving data for YW70204: {'auction_closing_time': 1774715329.0, 'created_time': 1773304875.824621, 'last_price_update_time': 1774694599.073189}
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW70204') HTTP/1.1" 204 0
2026-03-28 10:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98030%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for UH98030: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS27408%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for BS27408: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV69460%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for XV69460: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW52263%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for LW52263: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA66634%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for DA66634: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-28 10:43:19 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-28 10:43:19 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-28 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:20 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB88478%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for PB88478: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU13663%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for UU13663: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA83866%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for WA83866: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH92077%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for HH92077: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for YX62865: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ55407%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for ZZ55407: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL97889%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for JL97889: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU02845%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for YU02845: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for WR22738: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP74205%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for GP74205: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for VM58526: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM18539%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for VM18539: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for CE86831: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-28 10:43:20 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-28 10:43:20 [auto1.de] INFO: Scrape type for LK66468: 2
2026-03-28 10:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-28 10:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e03575-d261-531d-ace6-e2bffe3ab45b with scrape type 2
2026-03-28 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e03575-d261-531d-ace6-e2bffe3ab45b with scrape type 2
2026-03-28 10:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e03575-d261-531d-ace6-e2bffe3ab45b, identifier: LK66468
2026-03-28 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-28 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-28 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468 to the API
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 600,
 'expiration_date': '2026-03-28T16:06:39Z',
 'fuel_type': 'petrol',
 'id': 'e7e03575-d261-531d-ace6-e2bffe3ab45b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK66468',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q8',
 'odometer': 189488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-04',
 'seller_name': None,
 'title': 'Audi RS Q8 4.0 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-28 10:43:21 [auto1.de] INFO: Saving data for LK66468: {'auction_closing_time': 1774713999.0, 'created_time': 1774510243.737592, 'last_price_update_time': 1774694601.015935}
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK66468') HTTP/1.1" 204 0
2026-03-28 10:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:21 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 10:43:21 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR39575%27 HTTP/1.1" 200 None
2026-03-28 10:43:21 [auto1.de] INFO: Scrape type for TR39575: 0
2026-03-28 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:21 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:21 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-28 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for KN16725: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: ZK19786
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK19786%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for ZK19786: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for SA90137: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC48893%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for LC48893: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14498%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for SD14498: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP50687%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for KP50687: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99234%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for BN99234: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for AY72100: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA57423%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for ZA57423: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45405%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for UF45405: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-28 10:43:22 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-28 10:43:22 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-28 10:43:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:24 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: UE89498
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE89498%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for UE89498: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP09068%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for JP09068: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for BN35753: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for SU92551: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for EG23428: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for JG98331: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63993%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for DZ63993: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for AV28159: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11736%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for DH11736: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for HB39069: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH49394%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for FH49394: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72276%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for VH72276: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ19691%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for LJ19691: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-28 10:43:24 [auto1.de] INFO: Scrape type for UK33318: 0
2026-03-28 10:43:24 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-28 10:43:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:26 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU10384%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for LU10384: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW55555%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for SW55555: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX64051%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for DX64051: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for GC11554: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK91672%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for LK91672: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27876%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for DM27876: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for YJ03455: 2
2026-03-28 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-28 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddda53d1-a6df-580f-9fb1-60583f8d6c67 with scrape type 2
2026-03-28 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddda53d1-a6df-580f-9fb1-60583f8d6c67 with scrape type 2
2026-03-28 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddda53d1-a6df-580f-9fb1-60583f8d6c67, identifier: YJ03455
2026-03-28 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-28 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-28 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455 to the API
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:26:06Z',
 'fuel_type': 'petrol',
 'id': 'ddda53d1-a6df-580f-9fb1-60583f8d6c67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ03455',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 85676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Saving data for YJ03455: {'auction_closing_time': 1774715166.0, 'created_time': 1774510245.467084, 'last_price_update_time': 1774694607.263817}
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ03455') HTTP/1.1" 204 0
2026-03-28 10:43:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV13466%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for JV13466: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA25135%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for CA25135: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU11749%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for AU11749: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97847%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for BP97847: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW77677%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for AW77677: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS18572%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for JS18572: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD92059%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for JD92059: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for KF61768: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC58523%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for LC58523: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN81742%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for UN81742: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-28 10:43:27 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-28 10:43:27 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-28 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:28 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79624%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for AB79624: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC92798%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for VC92798: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK57616%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for SK57616: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH08441%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for FH08441: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN75370%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for TN75370: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02495%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for GD02495: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for ZR68100: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: YZ46630
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ46630%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for YZ46630: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL06566%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for BL06566: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS49041%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for KS49041: 0
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 10:43:28 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-28 10:43:28 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-28 10:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:30 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ96644%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for LZ96644: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83692%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for LR83692: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX71503%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for YX71503: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC37120%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for PC37120: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK07375%27 HTTP/1.1" 200 None
2026-03-28 10:43:30 [auto1.de] INFO: Scrape type for UK07375: 0
2026-03-28 10:43:30 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-28 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC17718%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for RC17718: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for YD41840: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ92359%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for LJ92359: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95896%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for AF95896: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN70998%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for DN70998: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR41029%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for DR41029: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY43658%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for PY43658: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36742%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for HD36742: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP88372%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for TP88372: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 10:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:32 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH94739%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for SH94739: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ04284%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for PZ04284: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS26500%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for ZS26500: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for BG27502: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40443%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for KM40443: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR13527%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for MR13527: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB98628%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for DB98628: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for MS10711: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS49761%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for BS49761: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32086%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for MK32086: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 10:43:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:44 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9651 | hits on page: 40
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72171%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for SD72171: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU27774%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for SU27774: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX73205%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for LX73205: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49047%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for WK49047: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA71155%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for BA71155: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for EV18023: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82091%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for GJ82091: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ18684%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for DZ18684: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22386%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for CS22386: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ41454%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for NZ41454: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: AT21596
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT21596%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for AT21596: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: ME93940
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME93940%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for ME93940: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK76037%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for PK76037: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD11825%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for ZD11825: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ46117%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for MJ46117: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT95404%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for VT95404: 0
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 10:43:44 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN84106%27 HTTP/1.1" 200 None
2026-03-28 10:43:44 [auto1.de] INFO: Scrape type for CN84106: 0
2026-03-28 10:43:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:46 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9651 | hits on page: 40
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR02791%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for XR02791: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE55302%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for XE55302: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49819%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for ZZ49819: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF61688%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for JF61688: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN55732%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for LN55732: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM30364%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for MM30364: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for NM13557: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for GU26871: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for CC98432: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK01073%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for RK01073: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM52195%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for YM52195: 0
2026-03-28 10:43:46 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-28 10:43:46 [auto1.de] INFO: Scrape type for VJ16820: 0
2026-03-28 10:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:48 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9651 | hits on page: 40
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT93387%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for FT93387: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56090%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for FH56090: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65350%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for JB65350: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: PY53054
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY53054%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for PY53054: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU64534%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for YU64534: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE42770%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for BE42770: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ27126%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for KJ27126: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: XA01561
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA01561%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for XA01561: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX12512%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for NX12512: 0
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 10:43:48 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-28 10:43:48 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-28 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:56 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9651 | hits on page: 40
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13791%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for YY13791: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81054%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for XS81054: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV98185%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for RV98185: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC55492%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for TC55492: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for LZ29816: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for JW22409: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: FE77986
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77986%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for FE77986: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for GB55517: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD97315%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for UD97315: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: YG22612
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-28 10:43:56 [auto1.de] INFO: Scrape type for RM92330: 0
2026-03-28 10:43:56 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-28 10:43:57 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB09580%27 HTTP/1.1" 200 None
2026-03-28 10:43:57 [auto1.de] INFO: Scrape type for YB09580: 0
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN40728%27 HTTP/1.1" 200 None
2026-03-28 10:43:57 [auto1.de] INFO: Scrape type for UN40728: 0
2026-03-28 10:43:57 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-28 10:43:57 [auto1.de] INFO: Scrape type for KU77644: 0
2026-03-28 10:43:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:59 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9652 | hits on page: 40
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for KU77644: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL63965%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for WL63965: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for PD02193: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for TY96424: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for ES32816: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE82925%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for GE82925: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK55447%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for BK55447: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-28 10:43:59 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-28 10:43:59 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL57383%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for RL57383: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for CC27418: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC93129%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for NC93129: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for KK41609: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM31508%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for HM31508: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for CN59781: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-28 10:44:00 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-28 10:44:00 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-28 10:44:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:01 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT61733%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for CT61733: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for PC62388: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE37337%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for AE37337: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for TD39885: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42918%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for KT42918: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: BB75752
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU97431%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for SU97431: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS70849%27 HTTP/1.1" 200 None
2026-03-28 10:44:01 [auto1.de] INFO: Scrape type for NS70849: 0
2026-03-28 10:44:01 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF90785%27 HTTP/1.1" 200 None
2026-03-28 10:44:02 [auto1.de] INFO: Scrape type for ZF90785: 0
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-28 10:44:02 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP51980%27 HTTP/1.1" 200 None
2026-03-28 10:44:02 [auto1.de] INFO: Scrape type for GP51980: 0
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16479%27 HTTP/1.1" 200 None
2026-03-28 10:44:02 [auto1.de] INFO: Scrape type for DV16479: 0
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-28 10:44:02 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-28 10:44:02 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-28 10:44:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:03 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV42849%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for VV42849: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57874%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for KD57874: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB20656%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for PB20656: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for TD77753: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for NK36025: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK74156%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for XK74156: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG76144%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for VG76144: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB82059%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for EB82059: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26984%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for VU26984: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for TM51786: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT42996%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for TT42996: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG35588%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for NG35588: 0
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 10:44:03 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-28 10:44:03 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-28 10:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:05 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for BT69693: 2
2026-03-28 10:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-28 10:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with scrape type 2
2026-03-28 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with scrape type 2
2026-03-28 10:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400, identifier: BT69693
2026-03-28 10:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-28 10:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-28 10:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693 to the API
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:18:11Z',
 'fuel_type': 'diesel',
 'id': '8baf42f3-bbe7-5155-b4b8-b4a42e6bd400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT69693',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 98337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi N-Connecta 4x4',
 'transmission': 'manual',
 'trim': 'N-Connecta 4x4',
 'year': 2018}
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Saving data for BT69693: {'auction_closing_time': 1774714691.0, 'created_time': 1774510243.372295, 'last_price_update_time': 1774694645.732835}
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT69693') HTTP/1.1" 204 0
2026-03-28 10:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP81387%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for RP81387: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW54654%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for KW54654: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA74097%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for CA74097: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: US56828
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56828%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for US56828: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL21406%27 HTTP/1.1" 200 None
2026-03-28 10:44:05 [auto1.de] INFO: Scrape type for PL21406: 0
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-28 10:44:05 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83058%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for YF83058: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS13333%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for TS13333: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC07612%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for LC07612: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57293%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for BC57293: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS42401%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for YS42401: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF56750%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for PF56750: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS34696%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for SS34696: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19877%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for ED19877: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for YK76722: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK01435%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for FK01435: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM97641%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for SM97641: 0
2026-03-28 10:44:06 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-28 10:44:06 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-28 10:44:06 [scrapy.extensions.logstats] INFO: Crawled 278 pages (at 19 pages/min), scraped 202 items (at 5 items/min)
2026-03-28 10:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:07 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36299%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for RM36299: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM22494%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for GM22494: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: FX28267
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX28267%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for FX28267: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG80520%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for VG80520: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ61913%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for LZ61913: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96220%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for CW96220: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: ZU82710
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA35608%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for EA35608: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP83751%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for BP83751: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP72809%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for MP72809: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB67262%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for PB67262: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP65043%27 HTTP/1.1" 200 None
2026-03-28 10:44:07 [auto1.de] INFO: Scrape type for DP65043: 0
2026-03-28 10:44:07 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-28 10:44:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:08 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-28 10:44:08 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-28 10:44:08 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-28 10:44:08 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-28 10:44:08 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-28 10:44:08 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-28 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML73813%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for ML73813: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for DC75837: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for JT65336: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for GB09367: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL60087%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for WL60087: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for UD38277: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR45674%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for CR45674: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91426%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for XB91426: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: GJ57760
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for GR60102: 0
2026-03-28 10:44:09 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-28 10:44:09 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-28 10:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:10 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93574%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for UW93574: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX91312%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for MX91312: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for JY81419: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ23867%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for EZ23867: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD74504%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for KD74504: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40243%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for RK40243: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for EC42355: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for WP33305: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK59865%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for JK59865: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT29365%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for VT29365: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP73357%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for MP73357: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH41759%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for AH41759: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 10:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:11 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD39094%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for KD39094: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for GB96559: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for WG34535: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB53133%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for KB53133: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ24227%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for PJ24227: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65516%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for JL65516: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH25431%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for DH25431: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN64642%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for SN64642: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53308%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for CP53308: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: RP45583
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09163%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for KV09163: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC98631%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for EC98631: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV69098%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for FV69098: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-28 10:44:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:13 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS47507%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for HS47507: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for UY83334: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC02899%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for VC02899: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP21456%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for CP21456: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81388%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for RB81388: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC05261%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XC05261: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY16629%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for NY16629: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC12904%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for JC12904: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX67317%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for SX67317: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XM71416: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30389%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for KR30389: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for ZR85378: 0
2026-03-28 10:44:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:14 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60205%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for JM60205: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC77974%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for XC77974: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for KT42001: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08182%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for SM08182: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU50689%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for WU50689: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: AF68122
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF68122%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for AF68122: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW10679%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for UW10679: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC80606%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for SC80606: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF80187%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for ZF80187: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT12374%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for ZT12374: 0
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for PD05251: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK64077%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for XK64077: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-28 10:44:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:16 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-28 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE76354%27 HTTP/1.1" 200 None
2026-03-28 10:44:16 [auto1.de] INFO: Scrape type for TE76354: 0
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-28 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM65900%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for EM65900: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42268%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for MG42268: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP16607%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for MP16607: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for NA04350: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH79634%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for LH79634: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA73784%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for HA73784: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69774%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for DZ69774: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR73965%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for YR73965: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ59846%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for JZ59846: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML82340%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for ML82340: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL40021%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for HL40021: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for GT12052: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL85266%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for ZL85266: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT10731%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for XT10731: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW98774%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for CW98774: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA15258%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for CA15258: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG64364%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for ZG64364: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07920%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for NM07920: 0
2026-03-28 10:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:18 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV07882%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for BV07882: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for UB19206: 2
2026-03-28 10:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-28 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24caabff-1c53-586c-9263-9d545a848c8a with scrape type 2
2026-03-28 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24caabff-1c53-586c-9263-9d545a848c8a with scrape type 2
2026-03-28 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24caabff-1c53-586c-9263-9d545a848c8a, identifier: UB19206
2026-03-28 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-28 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-28 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206 to the API
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:30:44Z',
 'fuel_type': 'petrol',
 'id': '24caabff-1c53-586c-9263-9d545a848c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB19206',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 282206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2008}
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Saving data for UB19206: {'auction_closing_time': 1774715444.0, 'created_time': 1774510234.520522, 'last_price_update_time': 1774694659.617312}
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB19206') HTTP/1.1" 204 0
2026-03-28 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for NB15408: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC41617%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for HC41617: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for YE23414: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT65198%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for ZT65198: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU86117%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for DU86117: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for NY45531: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC24669%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for LC24669: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY01980%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for LY01980: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for TP41556: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for GG09705: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33343%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for TH33343: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: MY07793
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY07793%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for MY07793: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for SS89837: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS21373%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for WS21373: 0
2026-03-28 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:21 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82281%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for UU82281: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU37876%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for RU37876: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24106%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for PG24106: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG59936%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for KG59936: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN35212%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for SN35212: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU03787%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for HU03787: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91072%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for VU91072: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for MN64369: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED76181%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for ED76181: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-28 10:44:21 [auto1.de] INFO: Scrape type for KW34435: 0
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-28 10:44:21 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 10:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:29 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU32216%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for LU32216: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG18023%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for TG18023: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP57494%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for PP57494: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU57672%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for NU57672: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98463%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for NX98463: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV47698%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for EV47698: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR04011%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for LR04011: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK66212%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for CK66212: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS52090%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for LS52090: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT39805%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for ZT39805: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00805%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for ZG00805: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW19833%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for MW19833: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR23222%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for XR23222: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW57612%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for AW57612: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV06990%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for VV06990: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for PV23969: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF17855%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for YF17855: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX38179%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for FX38179: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ72468%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for KZ72468: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN02679%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for GN02679: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for MW52698: 0
2026-03-28 10:44:29 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-28 10:44:29 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-28 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:31 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX50371%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for EX50371: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM53889%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for SM53889: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL37424%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for HL37424: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC75235%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for WC75235: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA54133%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for DA54133: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for RG17194: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for UV04779: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-28 10:44:31 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-28 10:44:31 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56073%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for WD56073: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK56220%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for HK56220: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: NC17523
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL96433%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for XL96433: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53350%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for NC53350: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02009%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for CP02009: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for BS00370: 2
2026-03-28 10:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-28 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c261eba5-387d-5572-afb8-50f1004bf8ac with scrape type 2
2026-03-28 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c261eba5-387d-5572-afb8-50f1004bf8ac with scrape type 2
2026-03-28 10:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c261eba5-387d-5572-afb8-50f1004bf8ac, identifier: BS00370
2026-03-28 10:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-28 10:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-28 10:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370 to the API
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:07:48Z',
 'fuel_type': 'petrol',
 'id': 'c261eba5-387d-5572-afb8-50f1004bf8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS00370',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 114453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Saving data for BS00370: {'auction_closing_time': 1774714068.0, 'created_time': 1773917573.028637, 'last_price_update_time': 1774694674.05962}
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS00370') HTTP/1.1" 204 0
2026-03-28 10:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-28 10:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:36 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-28 10:44:36 [auto1.de] INFO: Scrape type for GL55365: 0
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH13413%27 HTTP/1.1" 200 None
2026-03-28 10:44:36 [auto1.de] INFO: Scrape type for BH13413: 0
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-28 10:44:36 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH02957%27 HTTP/1.1" 200 None
2026-03-28 10:44:36 [auto1.de] INFO: Scrape type for ZH02957: 0
2026-03-28 10:44:36 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-28 10:44:36 [auto1.de] INFO: Scrape type for GT84792: 2
2026-03-28 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-28 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with scrape type 2
2026-03-28 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with scrape type 2
2026-03-28 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109, identifier: GT84792
2026-03-28 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-28 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-28 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792 to the API
2026-03-28 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:15:21Z',
 'fuel_type': 'petrol',
 'id': 'c973ae3a-eed1-5c9d-9a7c-4874e4a5d109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT84792',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 35134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Saving data for GT84792: {'auction_closing_time': 1774714521.0, 'created_time': 1773306690.158139, 'last_price_update_time': 1774694677.173083}
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT84792') HTTP/1.1" 204 0
2026-03-28 10:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS39411%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for DS39411: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS91117%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for VS91117: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14056%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for TD14056: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR62010%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for RR62010: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB59394%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for SB59394: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY48174%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for DY48174: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-28 10:44:37 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-28 10:44:37 [auto1.de] INFO: Scrape type for PA09921: 2
2026-03-28 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-28 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc5bd95-1f13-56e0-b9ef-ea3be09829ac with scrape type 2
2026-03-28 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc5bd95-1f13-56e0-b9ef-ea3be09829ac with scrape type 2
2026-03-28 10:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc5bd95-1f13-56e0-b9ef-ea3be09829ac, identifier: PA09921
2026-03-28 10:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-28 10:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-28 10:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921 to the API
2026-03-28 10:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:46:54Z',
 'fuel_type': 'diesel',
 'id': 'edc5bd95-1f13-56e0-b9ef-ea3be09829ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA09921',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 171760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'BMW 3er 320d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Saving data for PA09921: {'auction_closing_time': 1774716414.0, 'created_time': 1774510237.71743, 'last_price_update_time': 1774694678.348571}
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA09921') HTTP/1.1" 204 0
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11294%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Scrape type for UY11294: 0
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM40523%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Scrape type for HM40523: 0
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Scrape type for KA78171: 0
2026-03-28 10:44:38 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-28 10:44:38 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-28 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:39 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV26215%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for YV26215: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX44497%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for AX44497: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for JT36836: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS40295%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for SS40295: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC94959%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for JC94959: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48506%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for YT48506: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: WP44552
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP44552%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for WP44552: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK69228%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for LK69228: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA31515%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for KA31515: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP52122%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for JP52122: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94414%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for WB94414: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB35925%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for GB35925: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15178%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for GR15178: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-28 10:44:39 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-28 10:44:39 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-28 10:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:41 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD42571%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for FD42571: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS15462%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for HS15462: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for GP04405: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-28 10:44:41 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-28 10:44:41 [auto1.de] INFO: Scrape type for HZ51579: 2
2026-03-28 10:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-28 10:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6a7cee-e898-5406-a99a-adc5d63a00ac with scrape type 2
2026-03-28 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6a7cee-e898-5406-a99a-adc5d63a00ac with scrape type 2
2026-03-28 10:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff6a7cee-e898-5406-a99a-adc5d63a00ac, identifier: HZ51579
2026-03-28 10:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-28 10:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-28 10:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579 to the API
2026-03-28 10:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:25Z',
 'fuel_type': 'diesel',
 'id': 'ff6a7cee-e898-5406-a99a-adc5d63a00ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ51579',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 179632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': None,
 'title': 'Kia Optima 1.7 CRDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2016}
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Saving data for HZ51579: {'auction_closing_time': 1774715545.0, 'created_time': 1774510234.155591, 'last_price_update_time': 1774694682.650038}
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ51579') HTTP/1.1" 204 0
2026-03-28 10:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP05974%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for PP05974: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for RE35722: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL65079%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for YL65079: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for WA93069: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV90861%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for CV90861: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72700%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for VG72700: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR27506%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for KR27506: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for JR94106: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:43 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: GK61319
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16657%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for DV16657: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT67254%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for KT67254: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN04574%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for CN04574: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for GT95785: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08770%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for ME08770: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU09322%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for BU09322: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for YS02767: 2
2026-03-28 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-28 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f901f8-16cb-541a-a250-310ff383476d with scrape type 2
2026-03-28 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3f901f8-16cb-541a-a250-310ff383476d with scrape type 2
2026-03-28 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3f901f8-16cb-541a-a250-310ff383476d, identifier: YS02767
2026-03-28 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-28 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-28 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767 to the API
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'petrol',
 'id': 'e3f901f8-16cb-541a-a250-310ff383476d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS02767',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 116445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Saving data for YS02767: {'auction_closing_time': 1774716582.0, 'created_time': 1773946069.825738, 'last_price_update_time': 1774694685.355362}
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS02767') HTTP/1.1" 204 0
2026-03-28 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY52919%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for TY52919: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for RU06451: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB23073%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for FB23073: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:46 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for GR85769: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT39707%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for FT39707: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for GL08454: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for UW91893: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78227%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for CJ78227: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR71954%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for DR71954: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY14600%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for SY14600: 0
2026-03-28 10:44:46 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH98737%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for PH98737: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW86065%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for VW86065: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for VZ54866: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ08431%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for TJ08431: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ84353%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for NZ84353: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY22197%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for XY22197: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB34474%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for WB34474: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ81605%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for LZ81605: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-28 10:44:47 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 10:44:47 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-28 10:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:48 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM31567%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for YM31567: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85765%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for CV85765: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29521%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for AG29521: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: PB72951
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB72951%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for PB72951: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG52677%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for LG52677: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ83271%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for NZ83271: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET42367%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for ET42367: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG43761%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for WG43761: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for JW06785: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for KH68440: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA83567%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for RA83567: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for DU13995: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV07015%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for NV07015: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU68586%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for LU68586: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR01748%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for UR01748: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: KA74482
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA74482%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for KA74482: 0
2026-03-28 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:49 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08757%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for ZJ08757: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for FJ28912: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK04531%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for WK04531: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for NX49590: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK76126%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for CK76126: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for EA46191: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12708%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for YD12708: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25108%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for GW25108: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99793%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for YK99793: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for BF84298: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12333%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KT12333: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE74775%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for SE74775: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66092%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for VR66092: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-28 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83372%27 HTTP/1.1" 200 None
2026-03-28 10:44:50 [auto1.de] INFO: Scrape type for UC83372: 0
2026-03-28 10:44:50 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-28 10:44:50 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-28 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:51 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11625%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for LN11625: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75099%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for CJ75099: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV90609%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for GV90609: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA81558%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for NA81558: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP40821%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for RP40821: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: GN74176
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN74176%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for GN74176: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT54325%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for KT54325: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23335%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for YT23335: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX28873%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for BX28873: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR20535%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for YR20535: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY66150%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for RY66150: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for CJ93593: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-28 10:44:51 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 10:44:51 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 10:44:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:52 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for AP12446: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE84614%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for KE84614: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF74105%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for PF74105: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for PN40620: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER00491%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for ER00491: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: NR66161
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ67232%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for JJ67232: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ45391%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for KZ45391: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51720%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for VS51720: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03544%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for BJ03544: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-28 10:44:52 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-28 10:44:52 [auto1.de] INFO: Scrape type for AJ07817: 0
2026-03-28 10:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:53 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-28 10:44:53 [auto1.de] INFO: Scrape type for FJ58055: 0
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-28 10:44:53 [auto1.de] INFO: Scrape type for VB04886: 0
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-28 10:44:53 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-28 10:44:53 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB96456%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for BB96456: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY98929%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for AY98929: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD09031%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for RD09031: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43316%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for CZ43316: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95967%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for PB95967: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for WD56041: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF59044%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for UF59044: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH08334%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for SH08334: 0
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-28 10:44:54 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-28 10:44:54 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-28 10:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:55 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN60683%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for CN60683: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD98026%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for FD98026: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70928%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for AT70928: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH86268%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for ZH86268: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-28 10:44:55 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-28 10:44:55 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-28 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for EF20977: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC68946%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for WC68946: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP88597%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for XP88597: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27583%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for MC27583: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY58234%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for JY58234: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR35427%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for UR35427: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS68262%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for KS68262: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-28 10:44:56 [auto1.de] INFO: Scrape type for PC84380: 0
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 10:44:56 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-28 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:57 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:57 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 10:44:57 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-28 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB24690%27 HTTP/1.1" 200 None
2026-03-28 10:44:57 [auto1.de] INFO: Scrape type for RB24690: 2
2026-03-28 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a7e079a-a239-5140-b080-e5f7ac74aec2 with identifier: RB24690
2026-03-28 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a7e079a-a239-5140-b080-e5f7ac74aec2 with scrape type 2
2026-03-28 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a7e079a-a239-5140-b080-e5f7ac74aec2 with scrape type 2
2026-03-28 10:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a7e079a-a239-5140-b080-e5f7ac74aec2, identifier: RB24690
2026-03-28 10:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a7e079a-a239-5140-b080-e5f7ac74aec2 with identifier: RB24690
2026-03-28 10:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a7e079a-a239-5140-b080-e5f7ac74aec2 with identifier: RB24690
2026-03-28 10:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a7e079a-a239-5140-b080-e5f7ac74aec2 with identifier: RB24690 to the API
2026-03-28 10:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:01:29Z',
 'fuel_type': 'petrol',
 'id': '9a7e079a-a239-5140-b080-e5f7ac74aec2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB24690',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 103201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB24690%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Saving data for RB24690: {'auction_closing_time': 1774713689.0, 'created_time': 1774510235.807935, 'last_price_update_time': 1774694698.6431}
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB24690') HTTP/1.1" 204 0
2026-03-28 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07137%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for PY07137: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for WP32637: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for BV43542: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: US71908
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for BY01569: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37416%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for BG37416: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN39507%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for NN39507: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for LC01777: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK57644%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for VK57644: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU62087%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for VU62087: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR84704%27 HTTP/1.1" 200 None
2026-03-28 10:44:58 [auto1.de] INFO: Scrape type for CR84704: 0
2026-03-28 10:44:58 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST72008%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for ST72008: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG52162%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for HG52162: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP80923%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for XP80923: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: TC50609
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC50609%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for TC50609: 0
2026-03-28 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:59 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for TH64703: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: PJ00212
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ00212%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for PJ00212: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL42626%27 HTTP/1.1" 200 None
2026-03-28 10:44:59 [auto1.de] INFO: Scrape type for BL42626: 0
2026-03-28 10:44:59 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE66063%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for CE66063: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP49252%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for KP49252: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62056%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for BJ62056: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ35877%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for YJ35877: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS67917%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for NS67917: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55179%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for DD55179: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX80626%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for CX80626: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU60211%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for LU60211: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF01666%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for GF01666: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for DL96803: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for KA83204: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for DK56258: 0
2026-03-28 10:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:01 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for DK56258: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81382%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for BP81382: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22310%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for CN22310: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU80433%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for HU80433: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for MG35847: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for AK76136: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY72572%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for JY72572: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74023%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for FJ74023: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL55322%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for NL55322: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ44736%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for SZ44736: 0
2026-03-28 10:45:01 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE88755%27 HTTP/1.1" 200 None
2026-03-28 10:45:01 [auto1.de] INFO: Scrape type for TE88755: 0
2026-03-28 10:45:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:03 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM44045%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for XM44045: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL38936%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SL38936: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for ND84220: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03993%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SW03993: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL19665%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SL19665: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT39473%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for MT39473: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV83384%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SV83384: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN26382%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for HN26382: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL74517%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for AL74517: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ03862%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for RJ03862: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB22775%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for RB22775: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for DF48310: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for YY19012: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB33949%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for AB33949: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: BR94807
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD77911%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SD77911: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK07166%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for HK07166: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE50962%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for AE50962: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for PA10623: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for NP12620: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for VC66912: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00729%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for TD00729: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 10:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:04 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH83701%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for MH83701: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN96863%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for VN96863: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN16579%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for AN16579: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99158%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for HR99158: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT81603%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for AT81603: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72075%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for EX72075: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for RB55254: 0
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-28 10:45:04 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-28 10:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:05 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF15071%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for PF15071: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG72441%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for WG72441: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ18369%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for AZ18369: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: MJ34390
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX56329%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for WX56329: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for WA53567: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for VV73959: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96951%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for YA96951: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY15640%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for TY15640: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS96797%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for KS96797: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM55936%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for SM55936: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53059%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for DD53059: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU87387%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for LU87387: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ17598%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for SZ17598: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for GG45079: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB99974%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for HB99974: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA48754%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for ZA48754: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for NM38216: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96221%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for FH96221: 0
2026-03-28 10:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:06 [scrapy.extensions.logstats] INFO: Crawled 306 pages (at 28 pages/min), scraped 209 items (at 7 items/min)
2026-03-28 10:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:07 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR94578%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for PR94578: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for XG30345: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HR47989
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR47989%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for HR47989: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU29897%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for FU29897: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for HS83117: 2
2026-03-28 10:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-28 10:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501234cb-2272-5878-a3d0-c56835e253e8 with scrape type 2
2026-03-28 10:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 501234cb-2272-5878-a3d0-c56835e253e8 with scrape type 2
2026-03-28 10:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 501234cb-2272-5878-a3d0-c56835e253e8, identifier: HS83117
2026-03-28 10:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-28 10:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-28 10:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117 to the API
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 468,
 'expiration_date': '2026-03-28T16:32:28Z',
 'fuel_type': 'petrol',
 'id': '501234cb-2272-5878-a3d0-c56835e253e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS83117',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 203445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
 'transmission': 'automatic',
 'trim': 'HEMI SRT',
 'year': 2019}
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-28 10:45:08 [auto1.de] INFO: Saving data for HS83117: {'auction_closing_time': 1774715548.0, 'created_time': 1773227932.230839, 'last_price_update_time': 1774694708.847805}
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS83117') HTTP/1.1" 204 0
2026-03-28 10:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-28 10:45:08 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for WP00727: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02770%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for KW02770: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY11140%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for YY11140: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY24934%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for SY24934: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00491%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for PD00491: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for RE68011: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for HS45664: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05900%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for VT05900: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG33349%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for PG33349: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-28 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:10 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90123%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for DK90123: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ12624%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for AZ12624: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for MT86254: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for SR89713: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT34659%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for MT34659: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW21361%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for KW21361: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for CP67844: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77277%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for TS77277: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA96977%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for KA96977: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW41921%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for LW41921: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97314%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for PV97314: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN32159%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for FN32159: 0
2026-03-28 10:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:11 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for AU19422: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: XH77572
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19355%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for ZJ19355: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL64188%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for YL64188: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for VN84329: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for SK50734: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP94489%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for ZP94489: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82143%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for ZA82143: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for DZ51927: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA23936%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for RA23936: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for XA59462: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM65045%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for UM65045: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for YY27100: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: XP12912
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11902%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Scrape type for KZ11902: 0
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 10:45:11 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-28 10:45:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:12 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG53445%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for XG53445: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17963%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for FG17963: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ50772%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for CZ50772: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82024%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for MA82024: 2
2026-03-28 10:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35aef364-4b8b-5a63-8d4d-05b27035348a with identifier: MA82024
2026-03-28 10:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35aef364-4b8b-5a63-8d4d-05b27035348a with scrape type 2
2026-03-28 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35aef364-4b8b-5a63-8d4d-05b27035348a with scrape type 2
2026-03-28 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35aef364-4b8b-5a63-8d4d-05b27035348a, identifier: MA82024
2026-03-28 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35aef364-4b8b-5a63-8d4d-05b27035348a with identifier: MA82024
2026-03-28 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35aef364-4b8b-5a63-8d4d-05b27035348a with identifier: MA82024
2026-03-28 10:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35aef364-4b8b-5a63-8d4d-05b27035348a with identifier: MA82024 to the API
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:00:22Z',
 'fuel_type': 'petrol',
 'id': '35aef364-4b8b-5a63-8d4d-05b27035348a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA82024',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 149322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-29',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Roncalli Trendline',
 'transmission': 'manual',
 'trim': 'Roncalli Trendline',
 'year': 2011}
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82024%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Saving data for MA82024: {'auction_closing_time': 1774713622.0, 'created_time': 1773226837.756166, 'last_price_update_time': 1774694713.761767}
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA82024') HTTP/1.1" 204 0
2026-03-28 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19863%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for LX19863: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92372%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for TX92372: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH68668%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for SH68668: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV09393%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for LV09393: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ00184%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for FJ00184: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB61618%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for DB61618: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD50641%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for FD50641: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP49829%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for VP49829: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for PK44731: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ60410%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for GZ60410: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: VA48219
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for NA97113: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU60138%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for KU60138: 0
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP87124%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Scrape type for LP87124: 0
2026-03-28 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:15 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU60138%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for KU60138: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP87124%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for LP87124: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM30121%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for PM30121: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU41994%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for CU41994: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for AJ12624: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU54911%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for EU54911: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC12583%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for GC12583: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42971%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for CM42971: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV18768%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for NV18768: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for HM06155: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW69752%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for YW69752: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM11705%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for PM11705: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for AJ11776: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 10:45:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:16 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22727%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for CS22727: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: WX42639
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE00128%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for TE00128: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95154%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for MA95154: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for ZA27483: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV31181%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for WV31181: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: US20964
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG55912%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for GG55912: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE07247%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for LE07247: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE58425%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for KE58425: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-28 10:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:17 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT37929%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for MT37929: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN70157%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for NN70157: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76080%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for PB76080: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70410%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for ZZ70410: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB01512%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for MB01512: 2
2026-03-28 10:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with identifier: MB01512
2026-03-28 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with scrape type 2
2026-03-28 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with scrape type 2
2026-03-28 10:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09, identifier: MB01512
2026-03-28 10:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with identifier: MB01512
2026-03-28 10:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with identifier: MB01512
2026-03-28 10:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09 with identifier: MB01512 to the API
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:32:17Z',
 'fuel_type': 'petrol',
 'id': 'c9a4f5d3-75a5-53a2-98f3-fcfebfbbbf09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB01512',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 226880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB01512%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Saving data for MB01512: {'auction_closing_time': 1774715537.0, 'created_time': 1774510233.094403, 'last_price_update_time': 1774694719.656446}
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB01512') HTTP/1.1" 204 0
2026-03-28 10:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DL07796: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW75307%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for ZW75307: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20217%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for RU20217: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for LC23112: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH56837%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for RH56837: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH37075%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for NH37075: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL82017%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for RL82017: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT87490%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for WT87490: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY90714%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for LY90714: 0
2026-03-28 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:21 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF13757%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for DF13757: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51268%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for AA51268: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ05143%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for UJ05143: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ68403%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for ZZ68403: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ31189%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for WZ31189: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU46947%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for TU46947: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW69458%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for JW69458: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98155%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for ST98155: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR90100%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for CR90100: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU56361%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for JU56361: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW67106%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for FW67106: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13362%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for BG13362: 0
2026-03-28 10:45:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:22 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for GW59315: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for UC16251: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN67284%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for DN67284: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS07108%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for VS07108: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND37325%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for ND37325: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DP75483
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP99201%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for DP99201: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR35600%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for BR35600: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-28 10:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:23 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-28 10:45:23 [auto1.de] INFO: Scrape type for FB64910: 0
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN24500%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for KN24500: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE71150%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for BE71150: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ82357%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for HJ82357: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL20844%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for PL20844: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG66499%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for ZG66499: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for CC51739: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG86268%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for EG86268: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02719%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for VZ02719: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for XZ84287: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK78572%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for DK78572: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for PE88762: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 10:45:24 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU05759%27 HTTP/1.1" 200 None
2026-03-28 10:45:24 [auto1.de] INFO: Scrape type for AU05759: 0
2026-03-28 10:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:26 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:26 [auto1.de] INFO: Found listing with ID: HM98480
2026-03-28 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM98480%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for HM98480: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR37454%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for SR37454: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16279%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for WF16279: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT74133%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for FT74133: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV29285%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for PV29285: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ91818%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for XZ91818: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for EV41055: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME37510%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for ME37510: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC38309%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for JC38309: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06283%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for WS06283: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47974%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for HE47974: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF09771%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for KF09771: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR79365%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for KR79365: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 10:45:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:29 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA89468%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for AA89468: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM43280%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for DM43280: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ01332%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for EZ01332: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ74950%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for MJ74950: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for LM68672: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS20777%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for ZS20777: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for NY36854: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48587%27 HTTP/1.1" 200 None
2026-03-28 10:45:29 [auto1.de] INFO: Scrape type for DC48587: 0
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-28 10:45:29 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-28 10:45:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:31 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE53161%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for DE53161: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for NJ97251: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19740%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for GB19740: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM05379%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for ZM05379: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL74738%27 HTTP/1.1" 200 None
2026-03-28 10:45:31 [auto1.de] INFO: Scrape type for EL74738: 0
2026-03-28 10:45:31 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW29634%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for GW29634: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for SG73532: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for WY46685: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR06501%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for RR06501: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-28 10:45:32 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR53250%27 HTTP/1.1" 200 None
2026-03-28 10:45:32 [auto1.de] INFO: Scrape type for YR53250: 0
2026-03-28 10:45:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:38 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM90464%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for JM90464: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU90808%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for YU90808: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD43857%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for FD43857: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for UR23354: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83619%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for NX83619: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE84338%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for WE84338: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ70999%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for WZ70999: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM53620%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for DM53620: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for SK78109: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ80384%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for PJ80384: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for BR45511: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77331%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for TS77331: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for SE81381: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for TW05114: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH71289%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for BH71289: 0
2026-03-28 10:45:38 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP41401%27 HTTP/1.1" 200 None
2026-03-28 10:45:38 [auto1.de] INFO: Scrape type for VP41401: 0
2026-03-28 10:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:46:06 [scrapy.extensions.logstats] INFO: Crawled 320 pages (at 14 pages/min), scraped 212 items (at 3 items/min)
2026-03-28 10:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:47:06 [scrapy.extensions.logstats] INFO: Crawled 320 pages (at 0 pages/min), scraped 212 items (at 0 items/min)
2026-03-28 10:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:47:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.106(s), this was the 1st time calling it.
2026-03-28 10:47:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.681549100124817 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:57 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77331%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for TS77331: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for SE81381: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for TW05114: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH71289%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for BH71289: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP41401%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for VP41401: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB35490%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for RB35490: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: US80699
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80699%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for US80699: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG78965%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for HG78965: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH62107%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for UH62107: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE48609%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for DE48609: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52283%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for WG52283: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP69489%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for PP69489: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE14198%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for WE14198: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF99828%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for BF99828: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for VU57107: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 10:47:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:00 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD44846%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for KD44846: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM93918%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for TM93918: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH39337%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for UH39337: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF58468%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for VF58468: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN34545%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for GN34545: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05143%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for AX05143: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for GR51738: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for YU84960: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV66174%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for NV66174: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP32768%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for SP32768: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: BU31051
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX75874%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for AX75874: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS08220%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for RS08220: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for LZ64363: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA10756%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for NA10756: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA23337%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for VA23337: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for ZT91138: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 10:48:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:01 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS70576%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for WS70576: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR55805%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for LR55805: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC69837%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for NC69837: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK00710%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for WK00710: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for LD74655: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM65356%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for LM65356: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE59540%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for LE59540: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48302%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for NH48302: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for VZ82726: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS72322%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for CS72322: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ97284%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for EZ97284: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM53589%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for PM53589: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-28 10:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:02 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE64709%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for RE64709: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85429%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for AJ85429: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for DE92254: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34176%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for PJ34176: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT29846%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for CT29846: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM22977%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for PM22977: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED27900%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for ED27900: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW75197%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for XW75197: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20200%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for RU20200: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: SR33792
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW53708%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for VW53708: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA97546%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for VA97546: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG60568%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for BG60568: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF55396%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for TF55396: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-28 10:48:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:05 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL64623%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for SL64623: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK30483%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for SK30483: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for WW97819: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN48068%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for UN48068: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21542%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for NF21542: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG95815%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for YG95815: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP78886%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for YP78886: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: US88233
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US88233%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for US88233: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL03330%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for AL03330: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA17453%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for HA17453: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91103%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for PP91103: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65872%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for JH65872: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY63784%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for SY63784: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM84350%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for XM84350: 0
2026-03-28 10:48:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:06 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH12952%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for FH12952: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL87338%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for DL87338: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC31467%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for CC31467: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for ZM02354: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for GS35122: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM31431%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for ZM31431: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW13573%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for KW13573: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE01889%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for EE01889: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK25443%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for FK25443: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS70562%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for FS70562: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for XY75153: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for HS46985: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for JU05593: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for CA34591: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00405%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for JJ00405: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP79325%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for RP79325: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-28 10:48:07 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-28 10:48:07 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-28 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU08811%27 HTTP/1.1" 200 None
2026-03-28 10:48:07 [auto1.de] INFO: Scrape type for MU08811: 0
2026-03-28 10:48:07 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 6 pages/min), scraped 212 items (at 0 items/min)
2026-03-28 10:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:48:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:09 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79030%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for BH79030: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH88206%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for CH88206: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40091%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for KP40091: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: JB63291
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE29986%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for BE29986: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE64486%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for UE64486: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW56601%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for WW56601: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: NM87111
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP64202%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for UP64202: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: UC78818
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: FR76409
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR76409%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for FR76409: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW53480%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for EW53480: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: YB59373
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB59373%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for YB59373: 0
2026-03-28 10:48:09 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-28 10:48:09 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-28 10:48:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:20 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9666 | hits on page: 40
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72544%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for XV72544: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: CY78505
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY78505%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for CY78505: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR09634%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for KR09634: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: XD09814
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for ZH99212: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU98415%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for GU98415: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP17470%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for LP17470: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: XE74160
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE74160%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for XE74160: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-28 10:48:20 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-28 10:48:20 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-28 10:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:23 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9666 | hits on page: 40
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: CK75631
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: ZR47880
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX70553%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for DX70553: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: PT89540
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT83868%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for AT83868: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH57495%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for SH57495: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX02053%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for HX02053: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE15792%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for DE15792: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for YC07614: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG70840%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for EG70840: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW42181%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for TW42181: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for HU95530: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT13435%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for FT13435: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-28 10:48:23 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-28 10:48:23 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-28 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL13933%27 HTTP/1.1" 200 None
2026-03-28 10:48:24 [auto1.de] INFO: Scrape type for FL13933: 0
2026-03-28 10:48:24 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 10:48:24 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-28 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG79449%27 HTTP/1.1" 200 None
2026-03-28 10:48:24 [auto1.de] INFO: Scrape type for UG79449: 0
2026-03-28 10:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:26 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9666 | hits on page: 40
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF18301%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for MF18301: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY99757%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for EY99757: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: KJ94433
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ94433%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for KJ94433: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for SY52709: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC15327%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for GC15327: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: PC96089
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC96089%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for PC96089: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: LW74577
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73212%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for CZ73212: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: EV67878
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV67878%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for EV67878: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: SP13304
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP13304%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for SP13304: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40237%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for CX40237: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK60135%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for CK60135: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT50615%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for KT50615: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for ZU35260: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CR67511
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF12551%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for TF12551: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for NA95375: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-28 10:48:26 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33592%27 HTTP/1.1" 200 None
2026-03-28 10:48:26 [auto1.de] INFO: Scrape type for CY33592: 0
2026-03-28 10:48:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:30 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33592%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for CY33592: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU70567%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for FU70567: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for ZF79650: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT06922%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for UT06922: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: NY29547
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY29547%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for NY29547: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS57198%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for AS57198: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AK11207
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78978%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for WM78978: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV68122%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for AV68122: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX02207%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for AX02207: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: ZY72321
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS95642%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for AS95642: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB57025%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for CB57025: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-28 10:48:30 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-28 10:48:30 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-28 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW96945%27 HTTP/1.1" 200 None
2026-03-28 10:48:31 [auto1.de] INFO: Scrape type for WW96945: 0
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69388%27 HTTP/1.1" 200 None
2026-03-28 10:48:31 [auto1.de] INFO: Scrape type for JD69388: 0
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00232%27 HTTP/1.1" 200 None
2026-03-28 10:48:31 [auto1.de] INFO: Scrape type for BS00232: 0
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: FT69115
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: WC00524
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00524%27 HTTP/1.1" 200 None
2026-03-28 10:48:31 [auto1.de] INFO: Scrape type for WC00524: 0
2026-03-28 10:48:31 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-28 10:48:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:32 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: KU28834
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU28834%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for KU28834: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU12505%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for BU12505: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ65007%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for VZ65007: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: MF25653
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF25653%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for MF25653: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF65657%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for FF65657: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE80519%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for FE80519: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for CS88634: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: YY13895
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13895%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for YY13895: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: SS50589
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-28 10:48:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:33 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for GK14765: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: RC56290
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC56290%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for RC56290: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for AU99703: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: XU63236
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU63236%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for XU63236: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for UH34281: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27439%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for DF27439: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX06278%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for LX06278: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: WS06439
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06439%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for WS06439: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC12317%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for XC12317: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: BD00645
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD00645%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for BD00645: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: AT89899
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: DG30240
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL26956%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for UL26956: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC77177%27 HTTP/1.1" 200 None
2026-03-28 10:48:33 [auto1.de] INFO: Scrape type for RC77177: 0
2026-03-28 10:48:33 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-28 10:48:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:35 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: TD03088
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD03088%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for TD03088: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB01548%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for KB01548: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN89991%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for HN89991: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD71544%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for FD71544: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72421%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for FJ72421: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE12587%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for LE12587: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM34812%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for FM34812: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for MH30608: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU73818%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for CU73818: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for YB47144: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG55926%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for WG55926: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98327%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for MF98327: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR03247%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for TR03247: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90812%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for ED90812: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-28 10:48:35 [auto1.de] INFO: Scrape type for DE00247: 0
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 10:48:35 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 10:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:43 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: SW52819
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW52819%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for SW52819: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: WK09344
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK09344%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for WK09344: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ26253%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for EJ26253: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: BZ18787
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ15905%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for NJ15905: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for VE81778: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: GV82392
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH11075%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for KH11075: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: PW43450
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW43450%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for PW43450: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA38092%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for UA38092: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX58961%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for LX58961: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: CA26393
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for WC25701: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ09394%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for NZ09394: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: RZ83508
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ83508%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for RZ83508: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 10:48:43 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-28 10:48:43 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-28 10:48:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:47 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: CH57776
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27266%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for DF27266: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZZ35874
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: VH79690
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH79690%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for VH79690: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM73323%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for DM73323: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ19661%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for LZ19661: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98026%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for ZA98026: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ01230%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for TJ01230: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: DD25870
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF82683%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for LF82683: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: TA27217
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: AR87733
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC79153%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for YC79153: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-28 10:48:47 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-28 10:48:47 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-28 10:48:48 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW46825%27 HTTP/1.1" 200 None
2026-03-28 10:48:48 [auto1.de] INFO: Scrape type for FW46825: 0
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-28 10:48:48 [auto1.de] INFO: Scrape type for XE63092: 0
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 10:48:48 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-28 10:48:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:54 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: CH21169
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH21169%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for CH21169: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: KA16702
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA16702%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for KA16702: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS54687%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for BS54687: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP28641%27 HTTP/1.1" 200 None
2026-03-28 10:48:54 [auto1.de] INFO: Scrape type for EP28641: 0
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: UU77813
2026-03-28 10:48:54 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-28 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB36890%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for RB36890: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70988%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for FX70988: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90322%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for MD90322: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ83781%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for UZ83781: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for NZ57035: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY82090%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for SY82090: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA55919%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for UA55919: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU45926%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for UU45926: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63720%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for VU63720: 0
2026-03-28 10:48:55 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-28 10:48:55 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-28 10:48:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:58 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-28 10:48:58 [auto1.de] INFO: Scrape type for UM42416: 0
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR09135%27 HTTP/1.1" 200 None
2026-03-28 10:48:58 [auto1.de] INFO: Scrape type for XR09135: 0
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: BK51387
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-28 10:48:58 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: HV36396
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV36396%27 HTTP/1.1" 200 None
2026-03-28 10:48:58 [auto1.de] INFO: Scrape type for HV36396: 0
2026-03-28 10:48:58 [auto1.de] INFO: Found listing with ID: MR55647
2026-03-28 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR55647%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for MR55647: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ET88076
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41566%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for JJ41566: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC23327%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for HC23327: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ZF79989
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79989%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for ZF79989: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: MY79031
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58658%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for LL58658: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD19418%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for DD19418: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC90372%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for YC90372: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: PM76396
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR96778%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for KR96778: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: YR27652
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR27652%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for YR27652: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KW34660
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-28 10:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:01 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ45514%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for GJ45514: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: GE52020
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE52020%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for GE52020: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ42181%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for NZ42181: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED62579%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for ED62579: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: AT80326
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS28302%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for NS28302: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU00246%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for JU00246: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39089%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for WN39089: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DC41283
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC41283%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DC41283: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DT97256
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT97256%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DT97256: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65010%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for SP65010: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL78703%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for NL78703: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: VB40979
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40979%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for VB40979: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-28 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:02 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ42576%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for VJ42576: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: KP25975
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP25975%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for KP25975: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF94022%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for VF94022: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49680%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for ZX49680: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT96377%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for AT96377: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW53975%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for TW53975: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC97074%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for KC97074: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: VR22354
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: LS64729
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS64729%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for LS64729: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90588%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for MD90588: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for PF91020: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL04932%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for KL04932: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: DX07392
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: JZ39033
2026-03-28 10:49:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:04 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS55791%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for VS55791: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW58559%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for SW58559: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50252%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for AD50252: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY07442%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for LY07442: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UJ86189
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: KX31285
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX31285%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for KX31285: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: GD63015
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD63015%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for GD63015: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for PD23584: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU73961%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for BU73961: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09616%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for FP09616: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA70507%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for JA70507: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG42583%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for EG42583: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-28 10:49:05 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-28 10:49:05 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-28 10:49:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:06 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC28168%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for SC28168: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: LR63660
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR63660%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for LR63660: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV80796%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for MV80796: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ94268%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for ZJ94268: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for PZ85127: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: MF84483
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV82403%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for FV82403: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for CR26660: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: HX62286
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX62286%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for HX62286: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD85372%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for AD85372: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: JS52679
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS52679%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for JS52679: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for UX22346: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: PL74690
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA17370%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for TA17370: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: GD45566
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA28068%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for WA28068: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: WJ71939
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71939%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for WJ71939: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: UK33964
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33964%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for UK33964: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: YM61958
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM61958%27 HTTP/1.1" 200 None
2026-03-28 10:49:06 [auto1.de] INFO: Scrape type for YM61958: 0
2026-03-28 10:49:06 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 10:49:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:06 [scrapy.extensions.logstats] INFO: Crawled 342 pages (at 16 pages/min), scraped 212 items (at 0 items/min)
2026-03-28 10:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:41 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9671 | hits on page: 40
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: BX80092
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: DX36556
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX36556%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for DX36556: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for CV85999: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20941%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for SZ20941: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT09783%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for FT09783: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB92909%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for WB92909: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH63073%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for FH63073: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY11817%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for RY11817: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: MA95783
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95783%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for MA95783: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: KZ31354
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: EW67341
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67341%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for EW67341: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC08857%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for AC08857: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for TY90085: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: AJ01843
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ01843%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for AJ01843: 0
2026-03-28 10:49:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:44 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9671 | hits on page: 40
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: PY95410
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: XF50561
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45094%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for HU45094: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for PR75210: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP37190%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for UP37190: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR65508%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for YR65508: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09280%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for RT09280: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: JW05714
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05714%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for JW05714: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for BS29922: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: JE98088
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE98088%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for JE98088: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC71264%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for BC71264: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB54386%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for DB54386: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE70516%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for DE70516: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL83398%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for EL83398: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: XE96364
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: WH80890
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89986%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for TK89986: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS42122%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for CS42122: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26038%27 HTTP/1.1" 200 None
2026-03-28 10:49:44 [auto1.de] INFO: Scrape type for VU26038: 0
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 10:49:44 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 10:49:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:46 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ97744%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for FZ97744: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: HX03519
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ16181%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for UZ16181: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR67538%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for SR67538: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA31862%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for UA31862: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP87912%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for FP87912: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF93037%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for JF93037: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: LY36770
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ69098%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for ZZ69098: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: DR00758
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR00758%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for DR00758: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: ZK88504
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK88504%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for ZK88504: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU95569%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for DU95569: 0
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-28 10:49:46 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-28 10:49:46 [auto1.de] INFO: Scrape type for JE86051: 2
2026-03-28 10:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-28 10:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1d217d-4626-58fb-8a7a-f5257729c96b with scrape type 2
2026-03-28 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1d217d-4626-58fb-8a7a-f5257729c96b with scrape type 2
2026-03-28 10:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f1d217d-4626-58fb-8a7a-f5257729c96b, identifier: JE86051
2026-03-28 10:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-28 10:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-28 10:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051 to the API
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:13:45Z',
 'fuel_type': 'diesel',
 'id': '7f1d217d-4626-58fb-8a7a-f5257729c96b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE86051',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 157642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-28 10:49:47 [auto1.de] INFO: Saving data for JE86051: {'auction_closing_time': 1774714425.0, 'created_time': 1774423850.455398, 'last_price_update_time': 1774694987.781411}
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE86051') HTTP/1.1" 204 0
2026-03-28 10:49:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-28 10:49:47 [auto1.de] INFO: Scrape type for YL83790: 0
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA53494%27 HTTP/1.1" 200 None
2026-03-28 10:49:47 [auto1.de] INFO: Scrape type for TA53494: 0
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-28 10:49:47 [auto1.de] INFO: Scrape type for NP13175: 0
2026-03-28 10:49:47 [auto1.de] INFO: Found listing with ID: KS63717
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS63717%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for KS63717: 0
2026-03-28 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:50 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: GA14949
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA14949%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for GA14949: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: JG20363
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG20363%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for JG20363: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for KD43899: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL21584%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for XL21584: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: XK58974
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48727%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for TJ48727: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH00123%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for LH00123: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK15420%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for DK15420: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: WW30672
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30672%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for WW30672: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM70881%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for BM70881: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10251%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for VH10251: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: NR78945
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: NC53020
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53020%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for NC53020: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB60323%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for CB60323: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY34771%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for FY34771: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: AW34840
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW34840%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for AW34840: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83246%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for AP83246: 0
2026-03-28 10:49:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:52 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:52 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97143%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for YZ97143: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: XE27570
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE27570%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for XE27570: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for TV42528: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV18755%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for WV18755: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81619%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for FT81619: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for RA28898: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14653%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for CJ14653: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ55073%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for NZ55073: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28409%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for GU28409: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84028%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for ZX84028: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for DH94169: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for SB57558: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: GP04602
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04602%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for GP04602: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR78688%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for DR78688: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: ML80867
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY66745%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for BY66745: 0
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: ZD20982
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-28 10:49:53 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 10:49:53 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-28 10:49:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:00 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: VE74198
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE74198%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for VE74198: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF82570%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for RF82570: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for CT48596: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC02401%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for XC02401: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: CT34743
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for HN83229: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV12952%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for VV12952: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS15583%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for LS15583: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: XV84732
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: VR43125
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR43125%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for VR43125: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA20872%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for JA20872: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92395%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for SC92395: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: HD83782
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-28 10:50:00 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-28 10:50:00 [auto1.de] INFO: Found listing with ID: NH90612
2026-03-28 10:50:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:02 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:02 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-28 10:50:02 [auto1.de] INFO: Found listing with ID: VN15291
2026-03-28 10:50:02 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 10:50:02 [auto1.de] INFO: Found listing with ID: JH32543
2026-03-28 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH32543%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for JH32543: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05551%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for NA05551: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for KM31933: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA58573%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for XA58573: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: AL68838
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL68838%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for AL68838: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: AF55213
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF55213%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for AF55213: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: SL88176
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for XK43796: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: AM90654
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78750%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for XA78750: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32066%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for DC32066: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: LL60236
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60236%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for LL60236: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC86986%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for JC86986: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB99757%27 HTTP/1.1" 200 None
2026-03-28 10:50:03 [auto1.de] INFO: Scrape type for BB99757: 0
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-28 10:50:03 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-28 10:50:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:06 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 7 pages/min), scraped 213 items (at 1 items/min)
2026-03-28 10:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:09 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: TZ47982
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ47982%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for TZ47982: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: UZ74355
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74355%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for UZ74355: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: NS26780
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: TK16226
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK16226%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for TK16226: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT57890%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for TT57890: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: DJ51254
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: MC69974
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP89237%27 HTTP/1.1" 200 None
2026-03-28 10:50:09 [auto1.de] INFO: Scrape type for TP89237: 0
2026-03-28 10:50:09 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN03229%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for MN03229: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44936%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for LX44936: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84856%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for GB84856: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG03941%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for SG03941: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: UC97220
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA90460%27 HTTP/1.1" 200 None
2026-03-28 10:50:10 [auto1.de] INFO: Scrape type for CA90460: 0
2026-03-28 10:50:10 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-28 10:50:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:13 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98995%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for HG98995: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ03468%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for KJ03468: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: MU84465
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU84465%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for MU84465: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE21243%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for KE21243: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92284%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for XE92284: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: MD04990
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW12178%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for FW12178: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY98739%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for XY98739: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY08054%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for VY08054: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: ZJ77076
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77076%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for ZJ77076: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC91318%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for BC91318: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: SL22871
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: LE21028
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-28 10:50:13 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: MN16875
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: FJ59551
2026-03-28 10:50:13 [auto1.de] INFO: Found listing with ID: AV05824
2026-03-28 10:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV05824%27 HTTP/1.1" 200 None
2026-03-28 10:50:14 [auto1.de] INFO: Scrape type for AV05824: 0
2026-03-28 10:50:14 [auto1.de] INFO: Found listing with ID: JS88024
2026-03-28 10:50:14 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-28 10:50:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:15 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: EM02762
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: DW83875
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: AW09082
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW09082%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for AW09082: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: DR39868
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: XE25364
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for VS99519: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: BZ38132
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ38132%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for BZ38132: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: MS67851
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67851%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for MS67851: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: JY42391
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY42391%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for JY42391: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: RB92475
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: FZ45085
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45085%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for FZ45085: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: YE52514
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE52514%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for YE52514: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: AK40510
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK40510%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for AK40510: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: KM46516
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM46516%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for KM46516: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: PM59484
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA43957%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for YA43957: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: AC23396
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: BV95074
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: DY63135
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY63135%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for DY63135: 0
2026-03-28 10:50:15 [auto1.de] INFO: Found listing with ID: TH48846
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH48846%27 HTTP/1.1" 200 None
2026-03-28 10:50:15 [auto1.de] INFO: Scrape type for TH48846: 0
2026-03-28 10:50:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:19 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-28 10:50:19 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: NE41084
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-28 10:50:19 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-28 10:50:19 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-28 10:50:19 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: WW62013
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: WR30100
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: XV83680
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83680%27 HTTP/1.1" 200 None
2026-03-28 10:50:19 [auto1.de] INFO: Scrape type for XV83680: 0
2026-03-28 10:50:19 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-28 10:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: YH32821
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: AG95763
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG95763%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for AG95763: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: HB95845
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: WT35488
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT35488%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for WT35488: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: DV40651
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: RT81872
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81872%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for RT81872: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: VF65957
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: FS21817
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: NV29548
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: YC36661
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC36661%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for YC36661: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: FB28212
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB28212%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for FB28212: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: XV50730
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: AB51918
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB51918%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for AB51918: 0
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: WB14215
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: WX47681
2026-03-28 10:50:20 [auto1.de] INFO: Found listing with ID: FN84254
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN84254%27 HTTP/1.1" 200 None
2026-03-28 10:50:20 [auto1.de] INFO: Scrape type for FN84254: 0
2026-03-28 10:50:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:23 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: VL22817
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-28 10:50:23 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: VV56581
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV56581%27 HTTP/1.1" 200 None
2026-03-28 10:50:23 [auto1.de] INFO: Scrape type for VV56581: 0
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: PH05678
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: ZR87762
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR87762%27 HTTP/1.1" 200 None
2026-03-28 10:50:23 [auto1.de] INFO: Scrape type for ZR87762: 0
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-28 10:50:23 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-28 10:50:23 [auto1.de] INFO: Found listing with ID: CG13021
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: SW73326
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW73326%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for SW73326: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: FH57861
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: NR21385
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: UE28545
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: DP38441
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP38441%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for DP38441: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81781%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for TE81781: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: EZ75910
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: WF64949
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF64949%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for WF64949: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: LX19893
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: ED90776
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90776%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for ED90776: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: XB12574
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: GS10742
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS10742%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for GS10742: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: SB19152
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB19152%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for SB19152: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: VU26933
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: PV39631
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: BE79693
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: EL88156
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL88156%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for EL88156: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: UV51707
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV51707%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for UV51707: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: WJ30276
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ30276%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for WJ30276: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 10:50:24 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-28 10:50:24 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-28 10:50:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:26 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: HS07572
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS07572%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for HS07572: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: FG49990
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: EW66655
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW66655%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for EW66655: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: PG72252
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG72252%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for PG72252: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: MA26612
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: ST40572
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST40572%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for ST40572: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: JU35192
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: EL52738
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: ZH33487
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH33487%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for ZH33487: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-28 10:50:26 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 10:50:26 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 10:50:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:31 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: NZ73974
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: CG19122
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG19122%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for CG19122: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: TU49372
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49372%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for TU49372: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: US66505
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: TZ79275
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ79275%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for TZ79275: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: LW88840
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW88840%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for LW88840: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: TL33635
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: SX18617
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-28 10:50:31 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-28 10:50:31 [auto1.de] INFO: Found listing with ID: ZS32516
2026-03-28 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS32516%27 HTTP/1.1" 200 None
2026-03-28 10:50:32 [auto1.de] INFO: Scrape type for ZS32516: 0
2026-03-28 10:50:32 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-28 10:50:32 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-28 10:50:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:35 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: FP85945
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: KZ93271
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: EL64593
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: MJ27519
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: FV38538
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: FJ25741
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: AX65936
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: GZ32415
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ32415%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for GZ32415: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: JW43504
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: KX05072
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05072%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for KX05072: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: ST70161
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: NG47626
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG47626%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for NG47626: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: RU88109
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU88109%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for RU88109: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: ES58004
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-28 10:50:35 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 10:50:35 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 10:50:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:37 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: JA32150
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: XF72259
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-28 10:50:37 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: TE65215
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 10:50:37 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: JB48041
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB48041%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for JB48041: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: VK55236
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: YP75946
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: BE74196
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE74196%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for BE74196: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: MA19340
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA19340%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for MA19340: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: LA55679
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: PW59842
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW59842%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for PW59842: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: TE19568
2026-03-28 10:50:38 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-28 10:50:38 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-28 10:50:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:54 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9674 | hits on page: 40
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: WZ27773
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27773%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for WZ27773: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: CG60505
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60505%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for CG60505: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: JH49592
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: HJ47898
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ47898%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for HJ47898: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: JM37060
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: KB63529
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: KC83208
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DF80401
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF80401%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for DF80401: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: AK10230
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: XF71877
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF71877%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for XF71877: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: GE38296
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE38296%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for GE38296: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: TC10400
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC10400%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for TC10400: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LW37841
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW37841%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for LW37841: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: UZ23032
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: MU37788
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU37788%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for MU37788: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ST46361
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST46361%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ST46361: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: CV46070
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV46070%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for CV46070: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 10:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:51:06 [scrapy.extensions.logstats] INFO: Crawled 359 pages (at 10 pages/min), scraped 213 items (at 0 items/min)
2026-03-28 10:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:52:06 [scrapy.extensions.logstats] INFO: Crawled 359 pages (at 0 pages/min), scraped 213 items (at 0 items/min)
2026-03-28 10:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:53:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.547(s), this was the 1st time calling it.
2026-03-28 10:53:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.619395411969117 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:53:06 [scrapy.extensions.logstats] INFO: Crawled 359 pages (at 0 pages/min), scraped 213 items (at 0 items/min)
2026-03-28 10:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:53:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:12 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:12 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 10:53:12 [auto1.de] INFO: Found listing with ID: GE13857
2026-03-28 10:53:12 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE54237%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for YE54237: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: UC90003
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: PM00839
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: RA09675
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YN58840
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: SR24590
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: WP38302
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP38302%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for WP38302: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: LL32931
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: JR72370
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: LH42937
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH42937%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for LH42937: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: RK58200
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK58200%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for RK58200: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: NW48932
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: CU25460
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU25460%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for CU25460: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: LB53588
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: VU78681
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: NH66638
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH66638%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for NH66638: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YB76933
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB76933%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for YB76933: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: KB30822
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB30822%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for KB30822: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: UW51602
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: WB23557
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: PV88036
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88036%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for PV88036: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: PT29728
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: GR22729
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR22729%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for GR22729: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: FV31347
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: RL64280
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS97979%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for VS97979: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: WJ27645
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ27645%27 HTTP/1.1" 200 None
2026-03-28 10:53:13 [auto1.de] INFO: Scrape type for WJ27645: 0
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: YU45811
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: HJ23200
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 10:53:13 [auto1.de] INFO: Found listing with ID: LM35319
2026-03-28 10:53:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:15 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: ND92917
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: GC41711
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: RT85975
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: CZ37102
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ37102%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for CZ37102: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: UN55665
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: SX94415
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94415%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for SX94415: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: ZH78553
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH78553%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for ZH78553: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: GZ12434
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: EF19771
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF19771%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for EF19771: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: NJ07405
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ07405%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for NJ07405: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: TM10455
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM10455%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for TM10455: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: DM85685
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM85685%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for DM85685: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: EU26166
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26166%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for EU26166: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: GS88086
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS88086%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for GS88086: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: UH92417
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH92417%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for UH92417: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: ZF36287
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF36287%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for ZF36287: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: UY49029
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: PB03709
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: MT89119
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT89119%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for MT89119: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: LB55068
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB55068%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for LB55068: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: EV33886
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: DH53095
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: ES20702
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: BR66744
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR66744%27 HTTP/1.1" 200 None
2026-03-28 10:53:15 [auto1.de] INFO: Scrape type for BR66744: 0
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: SY93073
2026-03-28 10:53:15 [auto1.de] INFO: Found listing with ID: XE28025
2026-03-28 10:53:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:27 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: LB14503
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB14503%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for LB14503: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: DF28999
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28999%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for DF28999: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: PT66739
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66739%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for PT66739: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: MK93250
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93250%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for MK93250: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: SM85227
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: CG03839
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG03839%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for CG03839: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: YJ11714
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: NV96108
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV96108%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for NV96108: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: VY22890
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: DS58679
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: VL80954
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL80954%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for VL80954: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: ZE45705
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45705%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for ZE45705: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: DE08744
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE08744%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for DE08744: 0
2026-03-28 10:53:27 [auto1.de] INFO: Found listing with ID: EN22144
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN22144%27 HTTP/1.1" 200 None
2026-03-28 10:53:27 [auto1.de] INFO: Scrape type for EN22144: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: LA72906
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA72906%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for LA72906: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: MF16009
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: WK49027
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49027%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for WK49027: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: KG21612
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: YV29892
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: WZ80010
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ80010%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for WZ80010: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: CC70262
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70262%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for CC70262: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: DV15520
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV15520%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for DV15520: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: CT94694
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT94694%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for CT94694: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: VV43208
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV43208%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for VV43208: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: KL57981
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: CU33421
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU33421%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for CU33421: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: PF93593
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF93593%27 HTTP/1.1" 200 None
2026-03-28 10:53:28 [auto1.de] INFO: Scrape type for PF93593: 0
2026-03-28 10:53:28 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-28 10:53:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:29 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: KS12992
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12992%27 HTTP/1.1" 200 None
2026-03-28 10:53:29 [auto1.de] INFO: Scrape type for KS12992: 0
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: FH56262
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-28 10:53:29 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: MG09905
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG09905%27 HTTP/1.1" 200 None
2026-03-28 10:53:29 [auto1.de] INFO: Scrape type for MG09905: 0
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: MT78692
2026-03-28 10:53:29 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: LS44265
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: TC94851
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC94851%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for TC94851: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: TM61103
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM61103%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for TM61103: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: KT77585
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: XB19891
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB19891%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for XB19891: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: TJ66673
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ66673%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for TJ66673: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: DH53166
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH53166%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for DH53166: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: ZE31778
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: RD12421
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: RJ07463
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ07463%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for RJ07463: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: GE45533
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: GU99476
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: HF74785
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF74785%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for HF74785: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: EZ84115
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: CF13145
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13145%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for CF13145: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: EG69699
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG69699%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for EG69699: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: LZ69181
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ69181%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for LZ69181: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55078%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for BC55078: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: RL63795
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: WG13195
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG13195%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for WG13195: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: NT25501
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: US44062
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US44062%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for US44062: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: PA16133
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: TD01616
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD01616%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for TD01616: 0
2026-03-28 10:53:30 [auto1.de] INFO: Found listing with ID: YV04916
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV04916%27 HTTP/1.1" 200 None
2026-03-28 10:53:30 [auto1.de] INFO: Scrape type for YV04916: 0
2026-03-28 10:53:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:31 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: ES00815
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES00815%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for ES00815: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: EZ87167
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ87167%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for EZ87167: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: AB91886
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: FZ73081
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: ZZ70477
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70477%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for ZZ70477: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: FG85844
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG85844%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for FG85844: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: FX17983
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: LE68165
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: XV51445
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: NJ50287
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ50287%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for NJ50287: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: NN96342
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: GX56948
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX56948%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for GX56948: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: MC19465
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC19465%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for MC19465: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: BK94626
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94626%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for BK94626: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: ND36450
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: VB51991
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB51991%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for VB51991: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: NB13742
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: TH46997
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: EW90730
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW90730%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for EW90730: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: VN33107
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: EE21023
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE21023%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for EE21023: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: CX63821
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX63821%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for CX63821: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: JL38639
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: GR03981
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR03981%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for GR03981: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: GD37496
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD37496%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for GD37496: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: AM26890
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM26890%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for AM26890: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: PU65266
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU65266%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for PU65266: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: PW54296
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW54296%27 HTTP/1.1" 200 None
2026-03-28 10:53:31 [auto1.de] INFO: Scrape type for PW54296: 0
2026-03-28 10:53:31 [auto1.de] INFO: Found listing with ID: HU83271
2026-03-28 10:53:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:40 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: FR08984
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR08984%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for FR08984: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: ZA36261
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA36261%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for ZA36261: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: WC48972
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC48972%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for WC48972: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: VL97959
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97959%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for VL97959: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: XP39668
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP39668%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for XP39668: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: TE02637
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: AJ02147
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: JW75364
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75364%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for JW75364: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: BY93360
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY93360%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for BY93360: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: LZ33123
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: DW18994
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW18994%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for DW18994: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: TX71823
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX71823%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for TX71823: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: SH29410
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH29410%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for SH29410: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: FP38925
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP38925%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for FP38925: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA52681%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for FA52681: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW42716%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for AW42716: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: PS70153
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS70153%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for PS70153: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: ZT34226
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: TJ69662
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69662%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for TJ69662: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: GR93204
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: ME49426
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME49426%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for ME49426: 0
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: VH05156
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: AJ94093
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 10:53:40 [auto1.de] INFO: Found listing with ID: KN83228
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN83228%27 HTTP/1.1" 200 None
2026-03-28 10:53:40 [auto1.de] INFO: Scrape type for KN83228: 0
2026-03-28 10:53:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:53 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: SX49755
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: TE58325
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58325%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for TE58325: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: PB84737
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB84737%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for PB84737: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: FX80004
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80004%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for FX80004: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: CK93419
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93419%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for CK93419: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: TT01449
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: RX36269
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: MS42398
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: NX20586
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: TY55277
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55277%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for TY55277: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: XA91710
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: KD57513
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57513%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for KD57513: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: PD68131
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: LZ01049
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: VY10328
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: RC78324
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: BK70800
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK70800%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for BK70800: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: EN44355
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: SX37933
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: ZE74585
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE74585%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for ZE74585: 0
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 10:53:53 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-28 10:53:53 [auto1.de] INFO: Scrape type for ZV29308: 2
2026-03-28 10:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-28 10:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 2
2026-03-28 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 2
2026-03-28 10:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c69dda-dcac-5e57-8e79-44b586e0ef5c, identifier: ZV29308
2026-03-28 10:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-28 10:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-28 10:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308 to the API
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:29:58Z',
 'fuel_type': 'petrol',
 'id': '53c69dda-dcac-5e57-8e79-44b586e0ef5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV29308',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 37465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-28 10:53:54 [auto1.de] INFO: Saving data for ZV29308: {'auction_closing_time': 1774715398.0, 'created_time': 1774607719.695803, 'last_price_update_time': 1774695234.257482}
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV29308') HTTP/1.1" 204 0
2026-03-28 10:53:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: PA55939
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA55939%27 HTTP/1.1" 200 None
2026-03-28 10:53:54 [auto1.de] INFO: Scrape type for PA55939: 0
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-28 10:53:54 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: BH36406
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-28 10:53:54 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-28 10:53:54 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-28 10:53:54 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-28 10:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:53:59 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9675 | hits on page: 40
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: GA16313
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: RC54937
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: CN28958
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: KY35163
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: AA47357
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: XU32794
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-28 10:53:59 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 10:53:59 [auto1.de] INFO: Found listing with ID: TL68134
2026-03-28 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68134%27 HTTP/1.1" 200 None
2026-03-28 10:54:00 [auto1.de] INFO: Scrape type for TL68134: 0
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-28 10:54:00 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-28 10:54:00 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-28 10:54:00 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-28 10:54:00 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 10:54:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:03 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: ST20646
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST20646%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for ST20646: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: UF64612
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: LF59427
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF59427%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for LF59427: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: AD82327
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: KE33032
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: EP50641
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: LX99570
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX99570%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for LX99570: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: LA20568
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-28 10:54:03 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-28 10:54:03 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-28 10:54:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:05 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: CR14297
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR14297%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for CR14297: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: EY40312
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: DT18968
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: KD59460
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: AN41725
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41725%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for AN41725: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-28 10:54:05 [auto1.de] INFO: Found listing with ID: NN27576
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN27576%27 HTTP/1.1" 200 None
2026-03-28 10:54:05 [auto1.de] INFO: Scrape type for NN27576: 0
2026-03-28 10:54:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:06 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: NX98593
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: UK22144
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22144%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for UK22144: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: HF90366
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF90366%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for HF90366: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: LK57137
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57137%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for LK57137: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: NA93795
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: DZ81579
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ81579%27 HTTP/1.1" 200 None
2026-03-28 10:54:06 [auto1.de] INFO: Scrape type for DZ81579: 0
2026-03-28 10:54:06 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-28 10:54:07 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-28 10:54:07 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: ML18265
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: RT17429
2026-03-28 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17429%27 HTTP/1.1" 200 None
2026-03-28 10:54:07 [auto1.de] INFO: Scrape type for RT17429: 0
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: CN48396
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 10:54:07 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 10:54:07 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 11 pages/min), scraped 214 items (at 1 items/min)
2026-03-28 10:54:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:54:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:15 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: FF27762
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: YY58464
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: AM53740
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM53740%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for AM53740: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: EM43051
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: FF42926
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF42926%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for FF42926: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: TR57045
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR57045%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for TR57045: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: WM35972
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: DK79319
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: PK53003
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: VR97101
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: XH45962
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH45962%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for XH45962: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: ME71615
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME71615%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for ME71615: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: TT01725
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT01725%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for TT01725: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-28 10:54:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:16 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD73221%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for VD73221: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YE44037
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE44037%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for YE44037: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: PH72669
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH72669%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for PH72669: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: RX15047
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX15047%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for RX15047: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: SY58085
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY58085%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for SY58085: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: SR36375
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR36375%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for SR36375: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: YM65091
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: DX69622
2026-03-28 10:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:18 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: ZL39165
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: LX80768
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: JX03592
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX03592%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for JX03592: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: AM12190
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM12190%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for AM12190: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: RJ67815
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: ZY51606
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: RL99236
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS34341%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for YS34341: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SR10542
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: KJ72573
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ72573%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for KJ72573: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: JG05380
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG05380%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for JG05380: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-28 10:54:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:39 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9678 | hits on page: 40
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: NP38313
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: UR28246
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: WE47362
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE47362%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for WE47362: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: BP64224
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP64224%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for BP64224: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-28 10:54:39 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-28 10:54:39 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: SZ20099
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: LM23277
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: VM20095
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 10:54:40 [auto1.de] INFO: Found listing with ID: WA68038
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68038%27 HTTP/1.1" 200 None
2026-03-28 10:54:40 [auto1.de] INFO: Scrape type for WA68038: 0
2026-03-28 10:54:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:42 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9678 | hits on page: 40
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: TC39973
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39973%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for TC39973: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: YX67220
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX67220%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for YX67220: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: CC63606
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: SY49649
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: EA35621
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: DB64209
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: XG90247
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG90247%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for XG90247: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-28 10:54:42 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-28 10:54:42 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: KN40291
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN40291%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for KN40291: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: EP13780
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13780%27 HTTP/1.1" 200 None
2026-03-28 10:54:43 [auto1.de] INFO: Scrape type for EP13780: 0
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 10:54:43 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 10:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:47 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9679 | hits on page: 40
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: FK17094
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: GY29041
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY29041%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for GY29041: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: NB41059
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB41059%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for NB41059: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: YC14273
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC14273%27 HTTP/1.1" 200 None
2026-03-28 10:54:47 [auto1.de] INFO: Scrape type for YC14273: 0
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 10:54:47 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: UD03401
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD03401%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for UD03401: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: XY13260
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-28 10:54:48 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: SM01273
2026-03-28 10:54:48 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 10:54:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:49 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9679 | hits on page: 40
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: MW24531
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: XC03196
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC03196%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for XC03196: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: LM23776
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM23776%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for LM23776: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: JX94750
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX94750%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for JX94750: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: HF95044
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: HY44820
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: BC55238
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: EU79522
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79522%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for EU79522: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: GB06112
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB06112%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for GB06112: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-28 10:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:06 [scrapy.extensions.logstats] INFO: Crawled 377 pages (at 7 pages/min), scraped 214 items (at 0 items/min)
2026-03-28 10:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:23 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9680 | hits on page: 40
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: DD75704
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD75704%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for DD75704: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: GD94129
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: LB24374
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB24374%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for LB24374: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: JV29495
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29495%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for JV29495: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: KJ31397
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ31397%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for KJ31397: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-28 10:55:23 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-28 10:55:23 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: MJ97725
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ97725%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for MJ97725: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: NB03512
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB03512%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for NB03512: 0
2026-03-28 10:55:24 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-28 10:55:24 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-28 10:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:48 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: YN70037
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: ED74912
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: RV27328
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: HB28048
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: BJ89189
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: YJ80540
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ80540%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for YJ80540: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: HT24109
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: DS73409
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS73409%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for DS73409: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: HV05034
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV05034%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for HV05034: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: KT12988
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: YG16236
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG16236%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for YG16236: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-28 10:55:48 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-28 10:55:48 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-28 10:55:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:56 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AZ75969
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: HR56257
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: KA05574
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA05574%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for KA05574: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: VF13288
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: JU03795
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU03795%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for JU03795: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: RB44487
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: GD38856
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 10:55:56 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-28 10:55:56 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-28 10:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:05 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9681 | hits on page: 40
2026-03-28 10:56:05 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 10:56:05 [auto1.de] INFO: Found listing with ID: KR05534
2026-03-28 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR05534%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for KR05534: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: TU77981
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU77981%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for TU77981: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HP73171
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP73171%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for HP73171: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: RR39705
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR39705%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for RR39705: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: RS29820
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29820%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for RS29820: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HR99105
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: CJ52428
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52428%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for CJ52428: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: CX13035
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-28 10:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:06 [scrapy.extensions.logstats] INFO: Crawled 381 pages (at 4 pages/min), scraped 214 items (at 0 items/min)
2026-03-28 10:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:13 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9682 | hits on page: 40
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: FJ74822
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: LG96473
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96473%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for LG96473: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: CC79816
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: GH24213
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: WV66084
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66084%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for WV66084: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: HC51034
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC51034%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for HC51034: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: YY26065
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: LD89298
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD89298%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for LD89298: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: AX72910
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX72910%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for AX72910: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: VC37010
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC37010%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for VC37010: 0
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 10:56:13 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-28 10:56:13 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-28 10:56:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:15 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9682 | hits on page: 40
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: SB06685
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB06685%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for SB06685: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: DV41071
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: HR15403
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR15403%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for HR15403: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: RA84296
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA84296%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for RA84296: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: VG06126
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: AG71347
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-28 10:56:15 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 10:56:15 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-28 10:56:16 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: ZV51045
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV51045%27 HTTP/1.1" 200 None
2026-03-28 10:56:16 [auto1.de] INFO: Scrape type for ZV51045: 0
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-28 10:56:16 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-28 10:56:16 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 10:56:16 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-28 10:56:16 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-28 10:56:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:24 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9682 | hits on page: 40
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: WM07863
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM07863%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for WM07863: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: RS51050
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: MT04739
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT04739%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for MT04739: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: XZ00200
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ00200%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for XZ00200: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: GD72081
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: NN04046
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN04046%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for NN04046: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: BB09441
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: AW92079
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: RN79752
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN79752%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for RN79752: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: TG99958
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG99958%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for TG99958: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: WV47854
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: ZJ08773
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 10:56:24 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-28 10:56:24 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-28 10:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:44 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9683 | hits on page: 40
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: HY62666
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PD22194
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD22194%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for PD22194: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: CZ31886
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: CL03195
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: TN12094
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PY36433
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: YX04604
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX04604%27 HTTP/1.1" 200 None
2026-03-28 10:56:44 [auto1.de] INFO: Scrape type for YX04604: 0
2026-03-28 10:56:44 [auto1.de] INFO: Found listing with ID: SR70263
2026-03-28 10:56:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:45 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9683 | hits on page: 40
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: WJ48379
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: NA05625
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: LA17342
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: CP64616
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64616%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for CP64616: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: YV88881
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV88881%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for YV88881: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: XW21261
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW21261%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for XW21261: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: RN83637
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: VX93609
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: CY67531
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY67531%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for CY67531: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: EF86082
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF86082%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for EF86082: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: DX83058
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: ZA30968
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: RZ98922
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: ED07597
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED07597%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for ED07597: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: TR63216
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: FA61594
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-28 10:56:45 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-28 10:56:45 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-28 10:56:46 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-28 10:56:46 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-28 10:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:58 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9683 | hits on page: 40
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: SP08055
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP08055%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for SP08055: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: YM37957
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM37957%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for YM37957: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: VX80361
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: VF52184
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF52184%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for VF52184: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ZC13523
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13523%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for ZC13523: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: ZD82611
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 10:56:58 [auto1.de] INFO: Found listing with ID: BE55257
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55257%27 HTTP/1.1" 200 None
2026-03-28 10:56:58 [auto1.de] INFO: Scrape type for BE55257: 0
2026-03-28 10:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:59 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9683 | hits on page: 40
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: VD13122
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: ME79930
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME79930%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for ME79930: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: XG45401
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: EJ14046
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ14046%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for EJ14046: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-28 10:56:59 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 10:56:59 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: JB06991
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: NN29635
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29635%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for NN29635: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: SU34642
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: GZ05428
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ05428%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for GZ05428: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: CJ40917
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: JA99726
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA99726%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for JA99726: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: GJ23792
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ23792%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for GJ23792: 0
2026-03-28 10:57:00 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-28 10:57:00 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-28 10:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:03 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9683 | hits on page: 40
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: SJ81609
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: WJ23528
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ23528%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for WJ23528: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: XE45895
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE45895%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for XE45895: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: BN88120
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN88120%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for BN88120: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YT80911
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT80911%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YT80911: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RP62848
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP62848%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for RP62848: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: JJ98035
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LN28697
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: JY30766
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RF64064
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: EY31921
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31921%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for EY31921: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: GG87690
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: FA75858
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA75858%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for FA75858: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: WN52333
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: PA40823
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: AA44397
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-28 10:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:04 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9683 | hits on page: 40
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: HU51237
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: EM52017
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: UD22753
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD22753%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for UD22753: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: UE75515
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE75515%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for UE75515: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: YF40819
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF40819%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for YF40819: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: LD62620
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: US02257
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-28 10:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:06 [scrapy.extensions.logstats] INFO: Crawled 390 pages (at 9 pages/min), scraped 214 items (at 0 items/min)
2026-03-28 10:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:09 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9684 | hits on page: 40
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-28 10:57:09 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-28 10:57:09 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-28 10:57:09 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: XJ90591
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: FR11509
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: PE84798
2026-03-28 10:57:09 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: DS16746
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: RY43814
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY43814%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for RY43814: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: ER23285
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER23285%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for ER23285: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: NA61105
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA61105%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for NA61105: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: WM57318
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM57318%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for WM57318: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: CJ16536
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ16536%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for CJ16536: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: FW84422
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: MX67239
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX67239%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for MX67239: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: AM76407
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XR91127
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR91127%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for XR91127: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: AL22158
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL22158%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for AL22158: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: WK68156
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: FW15775
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: YY67246
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY67246%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for YY67246: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: RM23787
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: NP91596
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: GZ90473
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG40047%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for YG40047: 0
2026-03-28 10:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:28 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9685 | hits on page: 40
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG40047%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for YG40047: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: JA36918
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA36918%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for JA36918: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: UD76012
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD76012%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for UD76012: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: CE30304
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: PD48755
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: DF55322
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55322%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for DF55322: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18875%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for FV18875: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: BJ39418
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: RB15506
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB15506%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for RB15506: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: ZR64045
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: TZ06235
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ06235%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for TZ06235: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: WS17164
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS17164%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for WS17164: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: EU47039
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU47039%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for EU47039: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: CM43625
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: PY18559
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: MN13665
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN13665%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for MN13665: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: UJ44809
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: ZC16188
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55513%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for DD55513: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 10:57:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:58:06 [scrapy.extensions.logstats] INFO: Crawled 392 pages (at 2 pages/min), scraped 214 items (at 0 items/min)
2026-03-28 10:58:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:58:35 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9688 | hits on page: 40
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55513%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for DD55513: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: TT34866
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34866%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for TT34866: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: HS97116
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: MW11829
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW11829%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for MW11829: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: SZ87491
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ87491%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for SZ87491: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: HN55751
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN55751%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for HN55751: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: VY03646
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: WY86449
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: WL89525
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL89525%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for WL89525: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: XS52651
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: SZ51903
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: FL69651
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: FP03650
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP03650%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for FP03650: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-28 10:58:35 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 10:58:35 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: LF60633
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF60633%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for LF60633: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: VZ02444
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02444%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for VZ02444: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: FH65509
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH65509%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for FH65509: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: CU18716
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: WJ85082
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: TF47894
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: MX28919
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: XF17082
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: VZ57974
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ57974%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for VZ57974: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: CU58211
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU58211%27 HTTP/1.1" 200 None
2026-03-28 10:58:36 [auto1.de] INFO: Scrape type for CU58211: 0
2026-03-28 10:58:36 [auto1.de] INFO: Found listing with ID: CT99178
2026-03-28 10:58:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:58:38 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9688 | hits on page: 40
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: BU19474
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: LX20834
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX20834%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for LX20834: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: RS53381
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS53381%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for RS53381: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: FR48233
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR48233%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for FR48233: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: VC03178
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC03178%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for VC03178: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: AT04961
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: DP93170
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP93170%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for DP93170: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: MK25304
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: PV23410
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23410%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for PV23410: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: YT49063
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT49063%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for YT49063: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: FE23921
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE23921%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for FE23921: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: RR91619
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR91619%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for RR91619: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: HM21196
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: NK67778
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67778%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for NK67778: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: TV50499
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV50499%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for TV50499: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: RT04341
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT04341%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for RT04341: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: LK78383
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78383%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for LK78383: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: RH95863
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH95863%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for RH95863: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: DT99526
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: TL32343
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL32343%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for TL32343: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: NK05730
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK05730%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for NK05730: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: NY96837
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96837%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for NY96837: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: CW06535
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW06535%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for CW06535: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: SZ37158
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ37158%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for SZ37158: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: ZE95100
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: XK27021
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: NK77096
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK77096%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for NK77096: 0
2026-03-28 10:58:38 [auto1.de] INFO: Found listing with ID: JL68232
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL68232%27 HTTP/1.1" 200 None
2026-03-28 10:58:38 [auto1.de] INFO: Scrape type for JL68232: 0
2026-03-28 10:58:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:58:43 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9688 | hits on page: 40
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: WN51160
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: ED55965
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED55965%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for ED55965: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: EB27045
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB27045%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for EB27045: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: MB48491
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB48491%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for MB48491: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: JR79236
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: XH89248
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH89248%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for XH89248: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: XM39698
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM39698%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for XM39698: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: YP47874
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: AU99982
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: CM78199
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: XE06638
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: XC20184
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20184%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for XC20184: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: TW13952
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: SW03797
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03797%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for SW03797: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: MG59834
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: LU31167
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU31167%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for LU31167: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: EK22988
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK22988%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for EK22988: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: DA26658
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA26658%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for DA26658: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: LN54232
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54232%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for LN54232: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: UL22027
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: GA30636
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA30636%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for GA30636: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: JZ10962
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: NF93204
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: KK91293
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM89266%27 HTTP/1.1" 200 None
2026-03-28 10:58:43 [auto1.de] INFO: Scrape type for UM89266: 0
2026-03-28 10:58:43 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 10:58:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:06 [scrapy.extensions.logstats] INFO: Crawled 395 pages (at 3 pages/min), scraped 214 items (at 0 items/min)
2026-03-28 10:59:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 10:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:50 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM89266%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for UM89266: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: RD20926
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: BE69284
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: VE40725
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE40725%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for VE40725: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: KM24929
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: FS97701
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS97701%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for FS97701: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: DF26207
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: GA77173
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77173%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for GA77173: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: YZ37730
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: XX78597
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX78597%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for XX78597: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: LN26103
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: AN38948
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: KZ05570
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: YV73538
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73538%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for YV73538: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: LW15406
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: KU78731
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: PN43025
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: TW48699
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: HX62620
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: PD71224
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD71224%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for PD71224: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: DN90416
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: GG89436
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: SJ33830
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ33830%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for SJ33830: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: NE75834
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: RL39827
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL39827%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for RL39827: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-28 10:59:50 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 10:59:50 [auto1.de] INFO: Found listing with ID: AB28223
2026-03-28 10:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:52 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: CN50169
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: HH76288
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH76288%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for HH76288: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: US13530
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US13530%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for US13530: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-28 10:59:52 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-28 10:59:52 [auto1.de] INFO: Scrape type for YP37345: 2
2026-03-28 10:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-28 10:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 2
2026-03-28 10:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 2
2026-03-28 10:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e5d84cc-3980-51be-8873-f9077341de52, identifier: YP37345
2026-03-28 10:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-28 10:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-28 10:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345 to the API
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:20Z',
 'fuel_type': 'petrol',
 'id': '0e5d84cc-3980-51be-8873-f9077341de52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP37345',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 175874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Saving data for YP37345: {'auction_closing_time': 1774714340.0, 'created_time': 1774607790.957486, 'last_price_update_time': 1774695593.046227}
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP37345') HTTP/1.1" 204 0
2026-03-28 10:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: GX42293
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX42293%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for GX42293: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: ML17835
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML17835%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for ML17835: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: GW12084
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: CL86241
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-28 10:59:53 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-28 10:59:53 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 10:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:54 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: UR07800
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR07800%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for UR07800: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: KD93496
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD93496%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for KD93496: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: AL86714
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL86714%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for AL86714: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: SJ16961
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: VV03137
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03137%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for VV03137: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: ZS51994
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS51994%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for ZS51994: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 10:59:54 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-28 10:59:54 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-28 10:59:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:55 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NP21854
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NT84064
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NB66943
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB66943%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for NB66943: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NK75745
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: XT22823
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT22823%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for XT22823: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: AX94045
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX94045%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for AX94045: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: DZ46281
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: XF90946
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF90946%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for XF90946: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NJ92771
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ92771%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for NJ92771: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: AE68342
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68342%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for AE68342: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 10:59:55 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-28 10:59:55 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-28 10:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:57 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: AX67376
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX67376%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for AX67376: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: VW08133
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: LC14083
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC14083%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for LC14083: 0
2026-03-28 10:59:57 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Scrape type for PM13070: 2
2026-03-28 10:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-28 10:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84782f19-aa98-5fdc-97da-0f34e89c699a with scrape type 2
2026-03-28 10:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84782f19-aa98-5fdc-97da-0f34e89c699a with scrape type 2
2026-03-28 10:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84782f19-aa98-5fdc-97da-0f34e89c699a, identifier: PM13070
2026-03-28 10:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-28 10:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-28 10:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070 to the API
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:59:37Z',
 'fuel_type': 'petrol',
 'id': '84782f19-aa98-5fdc-97da-0f34e89c699a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM13070',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 60894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': "Kia cee'd 1.4 UEFA Euro 2016",
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2016}
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-28 10:59:57 [auto1.de] INFO: Saving data for PM13070: {'auction_closing_time': 1774717177.0, 'created_time': 1774607641.754233, 'last_price_update_time': 1774695597.953504}
2026-03-28 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM13070') HTTP/1.1" 204 0
2026-03-28 10:59:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: FN69423
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN69423%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for FN69423: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: EF60692
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: DR21754
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: YL43717
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: FH11160
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH11160%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for FH11160: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-28 10:59:58 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: ZM43235
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-28 10:59:58 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 10:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:59:59 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9692 | hits on page: 40
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: FP53719
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP53719%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for FP53719: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: EX24606
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: AE65824
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: GE88369
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: XG19073
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV99941%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for VV99941: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT40428%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for MT40428: 0
2026-03-28 10:59:59 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-28 10:59:59 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-28 10:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:00 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 11:00:00 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-28 11:00:00 [auto1.de] INFO: Scrape type for PD92865: 2
2026-03-28 11:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-28 11:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e316798-c173-5f1d-be5d-805589dc3c29 with scrape type 2
2026-03-28 11:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e316798-c173-5f1d-be5d-805589dc3c29 with scrape type 2
2026-03-28 11:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e316798-c173-5f1d-be5d-805589dc3c29, identifier: PD92865
2026-03-28 11:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-28 11:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-28 11:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865 to the API
2026-03-28 11:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:57Z',
 'fuel_type': 'diesel',
 'id': '1e316798-c173-5f1d-be5d-805589dc3c29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD92865',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 104383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Style+',
 'transmission': 'manual',
 'trim': 'Style+',
 'year': 2009}
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Saving data for PD92865: {'auction_closing_time': 1774716657.0, 'created_time': 1774607494.306384, 'last_price_update_time': 1774695601.130527}
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD92865') HTTP/1.1" 204 0
2026-03-28 11:00:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for MN30127: 2
2026-03-28 11:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-28 11:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 2
2026-03-28 11:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 2
2026-03-28 11:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7279628-8c27-54c7-a514-a6c484547c0b, identifier: MN30127
2026-03-28 11:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-28 11:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-28 11:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127 to the API
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:51:33Z',
 'fuel_type': 'petrol',
 'id': 'd7279628-8c27-54c7-a514-a6c484547c0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN30127',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 189708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 SIDI Turbo Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2014}
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Saving data for MN30127: {'auction_closing_time': 1774716693.0, 'created_time': 1774607885.211317, 'last_price_update_time': 1774695601.651265}
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN30127') HTTP/1.1" 204 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for TF66313: 2
2026-03-28 11:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-28 11:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2da829a-bd7b-52ba-8ce4-d18246b423b5 with scrape type 2
2026-03-28 11:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2da829a-bd7b-52ba-8ce4-d18246b423b5 with scrape type 2
2026-03-28 11:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2da829a-bd7b-52ba-8ce4-d18246b423b5, identifier: TF66313
2026-03-28 11:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-28 11:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-28 11:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313 to the API
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:35:26Z',
 'fuel_type': 'diesel',
 'id': 'c2da829a-bd7b-52ba-8ce4-d18246b423b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF66313',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 179510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-28 11:00:02 [auto1.de] INFO: Saving data for TF66313: {'auction_closing_time': 1774715726.0, 'created_time': 1774607528.581171, 'last_price_update_time': 1774695602.399763}
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF66313') HTTP/1.1" 204 0
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-28 11:00:02 [auto1.de] INFO: Scrape type for CZ12085: 2
2026-03-28 11:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-28 11:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with scrape type 2
2026-03-28 11:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with scrape type 2
2026-03-28 11:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03, identifier: CZ12085
2026-03-28 11:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-28 11:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-28 11:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085 to the API
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:42Z',
 'fuel_type': 'diesel',
 'id': '9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ12085',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 252305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-06',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-28 11:00:02 [auto1.de] INFO: Saving data for CZ12085: {'auction_closing_time': 1774714542.0, 'created_time': 1774607862.511246, 'last_price_update_time': 1774695602.849672}
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ12085') HTTP/1.1" 204 0
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 11:00:02 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-28 11:00:02 [auto1.de] INFO: Scrape type for YA08912: 2
2026-03-28 11:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-28 11:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-28 11:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-28 11:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b, identifier: YA08912
2026-03-28 11:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-28 11:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-28 11:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912 to the API
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:40:47Z',
 'fuel_type': 'diesel',
 'id': '8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA08912',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 130337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2013}
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Saving data for YA08912: {'auction_closing_time': 1774716047.0, 'created_time': 1773830607.538681, 'last_price_update_time': 1774695604.134753}
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA08912') HTTP/1.1" 204 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for CJ52783: 2
2026-03-28 11:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-28 11:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-28 11:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-28 11:00:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd51997c-a2b2-546a-a07c-8c0a10a46ef2, identifier: CJ52783
2026-03-28 11:00:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-28 11:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-28 11:00:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783 to the API
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'petrol',
 'id': 'cd51997c-a2b2-546a-a07c-8c0a10a46ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ52783',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 41419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Saving data for CJ52783: {'auction_closing_time': 1774713982.0, 'created_time': 1773304833.969446, 'last_price_update_time': 1774695604.838232}
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ52783') HTTP/1.1" 204 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for EH62859: 2
2026-03-28 11:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-28 11:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-28 11:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-28 11:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46ab2e5-08a6-5070-8622-2b06d986e09e, identifier: EH62859
2026-03-28 11:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-28 11:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-28 11:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859 to the API
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:23:36Z',
 'fuel_type': 'petrol',
 'id': 'c46ab2e5-08a6-5070-8622-2b06d986e09e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH62859',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 84599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-04',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2020}
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Saving data for EH62859: {'auction_closing_time': 1774715016.0, 'created_time': 1773302392.451953, 'last_price_update_time': 1774695605.4504}
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH62859') HTTP/1.1" 204 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for FY64526: 2
2026-03-28 11:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-28 11:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-28 11:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-28 11:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8, identifier: FY64526
2026-03-28 11:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-28 11:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-28 11:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526 to the API
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:44:32Z',
 'fuel_type': 'diesel',
 'id': '68d25788-6d5f-503c-a51c-b95d0d8ed2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY64526',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 182219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Saving data for FY64526: {'auction_closing_time': 1774716272.0, 'created_time': 1773917492.14851, 'last_price_update_time': 1774695606.471098}
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY64526') HTTP/1.1" 204 0
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Scrape type for GX15527: 2
2026-03-28 11:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-28 11:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-28 11:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-28 11:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612e31c7-00f2-5460-90f2-80f2586d9e8a, identifier: GX15527
2026-03-28 11:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-28 11:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-28 11:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527 to the API
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:25Z',
 'fuel_type': 'petrol',
 'id': '612e31c7-00f2-5460-90f2-80f2586d9e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX15527',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 96818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Saving data for GX15527: {'auction_closing_time': 1774714165.0, 'created_time': 1773945776.74106, 'last_price_update_time': 1774695606.930723}
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX15527') HTTP/1.1" 204 0
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Scrape type for YL92844: 2
2026-03-28 11:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-28 11:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 2
2026-03-28 11:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 2
2026-03-28 11:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7a430bd-5867-52e7-bb37-7078639a2673, identifier: YL92844
2026-03-28 11:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:07 [scrapy.extensions.logstats] INFO: Crawled 403 pages (at 8 pages/min), scraped 225 items (at 11 items/min)
2026-03-28 11:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-28 11:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-28 11:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844 to the API
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:24:40Z',
 'fuel_type': 'petrol',
 'id': 'c7a430bd-5867-52e7-bb37-7078639a2673',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL92844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 46532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-28 11:00:07 [auto1.de] INFO: Saving data for YL92844: {'auction_closing_time': 1774715080.0, 'created_time': 1774607654.392144, 'last_price_update_time': 1774695607.437534}
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL92844') HTTP/1.1" 204 0
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-28 11:00:07 [auto1.de] INFO: Scrape type for WG78869: 2
2026-03-28 11:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-28 11:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 2
2026-03-28 11:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 2
2026-03-28 11:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e6af-c309-5511-a47e-0cf99fc5d6e6, identifier: WG78869
2026-03-28 11:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-28 11:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-28 11:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869 to the API
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:52Z',
 'fuel_type': 'diesel',
 'id': 'c245e6af-c309-5511-a47e-0cf99fc5d6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG78869',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 258605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-05-11',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 1999}
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Saving data for WG78869: {'auction_closing_time': 1774716052.0, 'created_time': 1774607498.436062, 'last_price_update_time': 1774695608.773819}
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG78869') HTTP/1.1" 204 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for WM31367: 2
2026-03-28 11:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-28 11:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-28 11:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-28 11:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c1b5fc7-88fb-5545-8e7e-850e61202739, identifier: WM31367
2026-03-28 11:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-28 11:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-28 11:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367 to the API
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:29:06Z',
 'fuel_type': 'petrol',
 'id': '5c1b5fc7-88fb-5545-8e7e-850e61202739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM31367',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 72082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2020}
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Saving data for WM31367: {'auction_closing_time': 1774715346.0, 'created_time': 1772546454.546687, 'last_price_update_time': 1774695609.263051}
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM31367') HTTP/1.1" 204 0
2026-03-28 11:00:09 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for MG37810: 2
2026-03-28 11:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-28 11:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 2
2026-03-28 11:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 2
2026-03-28 11:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da3d3d4-b79d-5360-9701-7138af02912b, identifier: MG37810
2026-03-28 11:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-28 11:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-28 11:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810 to the API
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:58:29Z',
 'fuel_type': 'petrol',
 'id': '6da3d3d4-b79d-5360-9701-7138af02912b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG37810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 86259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-20',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Saving data for MG37810: {'auction_closing_time': 1774717109.0, 'created_time': 1774607527.509987, 'last_price_update_time': 1774695609.755181}
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG37810') HTTP/1.1" 204 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for WM50806: 2
2026-03-28 11:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-28 11:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 2
2026-03-28 11:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 2
2026-03-28 11:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f834236-0c7f-557c-9693-c1c9802a73b0, identifier: WM50806
2026-03-28 11:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-28 11:00:10 [auto1.de] INFO: Scrape type for NK83819: 2
2026-03-28 11:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-28 11:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 2
2026-03-28 11:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 2
2026-03-28 11:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5f9f659-1548-59ce-a865-56311a1774ba, identifier: NK83819
2026-03-28 11:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-28 11:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-28 11:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806 to the API
2026-03-28 11:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:12:04Z',
 'fuel_type': 'petrol',
 'id': '7f834236-0c7f-557c-9693-c1c9802a73b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM50806',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 189207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Saving data for WM50806: {'auction_closing_time': 1774714324.0, 'created_time': 1774607644.782619, 'last_price_update_time': 1774695611.197074}
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM50806') HTTP/1.1" 204 0
2026-03-28 11:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-28 11:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-28 11:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819 to the API
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:43:25Z',
 'fuel_type': 'petrol',
 'id': 'd5f9f659-1548-59ce-a865-56311a1774ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK83819',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 169450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Saving data for NK83819: {'auction_closing_time': 1774716205.0, 'created_time': 1774607500.998042, 'last_price_update_time': 1774695611.877681}
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK83819') HTTP/1.1" 204 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for FJ71041: 2
2026-03-28 11:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-28 11:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-28 11:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-28 11:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3, identifier: FJ71041
2026-03-28 11:00:12 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-28 11:00:12 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 11:00:12 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-28 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-28 11:00:12 [auto1.de] INFO: Scrape type for TE41931: 2
2026-03-28 11:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-28 11:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0366b08b-3323-5348-9f58-b06c9b82d43a with scrape type 2
2026-03-28 11:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0366b08b-3323-5348-9f58-b06c9b82d43a with scrape type 2
2026-03-28 11:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0366b08b-3323-5348-9f58-b06c9b82d43a, identifier: TE41931
2026-03-28 11:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-28 11:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-28 11:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041 to the API
2026-03-28 11:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:13Z',
 'fuel_type': 'petrol',
 'id': '491aaf14-d194-56ff-9ea6-d5f7177e1bb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71041',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 79714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-02',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2022}
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-28 11:00:13 [auto1.de] INFO: Saving data for FJ71041: {'auction_closing_time': 1774715293.0, 'created_time': 1773229493.252307, 'last_price_update_time': 1774695613.5884}
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ71041') HTTP/1.1" 204 0
2026-03-28 11:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-28 11:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-28 11:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931 to the API
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:51:02Z',
 'fuel_type': 'petrol',
 'id': '0366b08b-3323-5348-9f58-b06c9b82d43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE41931',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 176011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-28 11:00:13 [auto1.de] INFO: Saving data for TE41931: {'auction_closing_time': 1774716662.0, 'created_time': 1774607864.078061, 'last_price_update_time': 1774695613.901344}
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE41931') HTTP/1.1" 204 0
2026-03-28 11:00:13 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-28 11:00:13 [auto1.de] INFO: Scrape type for RT27360: 2
2026-03-28 11:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-28 11:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-28 11:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-28 11:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897, identifier: RT27360
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for PD33755: 2
2026-03-28 11:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-28 11:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-28 11:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-28 11:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9, identifier: PD33755
2026-03-28 11:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-28 11:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-28 11:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360 to the API
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'petrol',
 'id': '1053ddd0-2e1c-51ce-aaa8-24d04d06c897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT27360',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 13951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-19',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
 'transmission': 'automatic',
 'trim': 'Evolution',
 'year': 2023}
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Saving data for RT27360: {'auction_closing_time': 1774716301.0, 'created_time': 1773426998.384676, 'last_price_update_time': 1774695615.57556}
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT27360') HTTP/1.1" 204 0
2026-03-28 11:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-28 11:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-28 11:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755 to the API
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:52Z',
 'fuel_type': 'diesel',
 'id': 'fc787f5f-1bb5-5093-a3d6-9f28304ec9a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD33755',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 199225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-27',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.de] INFO: Saving data for PD33755: {'auction_closing_time': 1774715992.0, 'created_time': 1773429093.606501, 'last_price_update_time': 1774695616.263089}
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD33755') HTTP/1.1" 204 0
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.de] INFO: Scrape type for EM63340: 2
2026-03-28 11:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-28 11:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f83d7a-9e20-5a0f-ade1-0a60276be417 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68f83d7a-9e20-5a0f-ade1-0a60276be417 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68f83d7a-9e20-5a0f-ade1-0a60276be417, identifier: EM63340
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 11:00:16 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.de] INFO: Scrape type for MW31978: 2
2026-03-28 11:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-28 11:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7, identifier: MW31978
2026-03-28 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-28 11:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-28 11:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340 to the API
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:38:32Z',
 'fuel_type': 'petrol',
 'id': '68f83d7a-9e20-5a0f-ade1-0a60276be417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM63340',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 185459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-12',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-28 11:00:17 [auto1.de] INFO: Saving data for EM63340: {'auction_closing_time': 1774715912.0, 'created_time': 1774607675.061764, 'last_price_update_time': 1774695617.841511}
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM63340') HTTP/1.1" 204 0
2026-03-28 11:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-28 11:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-28 11:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978 to the API
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:05Z',
 'fuel_type': 'petrol',
 'id': 'c3d1ba04-710d-568f-97ee-d9ca1e5da2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW31978',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 46994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.de] INFO: Saving data for MW31978: {'auction_closing_time': 1774715345.0, 'created_time': 1773775515.30162, 'last_price_update_time': 1774695618.304014}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW31978') HTTP/1.1" 204 0
2026-03-28 11:00:18 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.de] INFO: Scrape type for TL42173: 2
2026-03-28 11:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-28 11:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cebd0460-5f0e-5091-be95-be83e214fcca, identifier: TL42173
2026-03-28 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-28 11:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-28 11:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173 to the API
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:00:35Z',
 'fuel_type': 'petrol',
 'id': 'cebd0460-5f0e-5091-be95-be83e214fcca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL42173',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 109274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.de] INFO: Saving data for TL42173: {'auction_closing_time': 1774713635.0, 'created_time': 1774071034.545013, 'last_price_update_time': 1774695618.756604}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL42173') HTTP/1.1" 204 0
2026-03-28 11:00:18 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 11:00:18 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 11:00:18 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.de] INFO: Scrape type for MB94614: 2
2026-03-28 11:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-28 11:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1032f9-30d9-5536-8bf8-dd10bd336f3e with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1032f9-30d9-5536-8bf8-dd10bd336f3e with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1032f9-30d9-5536-8bf8-dd10bd336f3e, identifier: MB94614
2026-03-28 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-28 11:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-28 11:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614 to the API
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:48:09Z',
 'fuel_type': 'petrol',
 'id': 'da1032f9-30d9-5536-8bf8-dd10bd336f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB94614',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 173801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7 Emotion",
 'transmission': 'manual',
 'trim': 'Edition 7 Emotion',
 'year': 2018}
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.de] INFO: Saving data for MB94614: {'auction_closing_time': 1774716489.0, 'created_time': 1774607883.928163, 'last_price_update_time': 1774695619.177076}
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB94614') HTTP/1.1" 204 0
2026-03-28 11:00:19 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 11:00:19 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-28 11:00:19 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-28 11:00:19 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.de] INFO: Scrape type for ZK28238: 2
2026-03-28 11:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-28 11:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4eeb5d-6e91-5755-b416-1a790dfd96ac with scrape type 2
2026-03-28 11:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da4eeb5d-6e91-5755-b416-1a790dfd96ac with scrape type 2
2026-03-28 11:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da4eeb5d-6e91-5755-b416-1a790dfd96ac, identifier: ZK28238
2026-03-28 11:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-28 11:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-28 11:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238 to the API
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:01:57Z',
 'fuel_type': 'diesel',
 'id': 'da4eeb5d-6e91-5755-b416-1a790dfd96ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK28238',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 290983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-26',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Saving data for ZK28238: {'auction_closing_time': 1774713717.0, 'created_time': 1774607542.101111, 'last_price_update_time': 1774695620.589657}
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK28238') HTTP/1.1" 204 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for YW88691: 2
2026-03-28 11:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-28 11:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 2
2026-03-28 11:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 2
2026-03-28 11:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2636e10-6ba9-578c-ada5-3013d96fdaad, identifier: YW88691
2026-03-28 11:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-28 11:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-28 11:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691 to the API
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:23:03Z',
 'fuel_type': 'diesel',
 'id': 'e2636e10-6ba9-578c-ada5-3013d96fdaad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW88691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 220940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.de] INFO: Saving data for YW88691: {'auction_closing_time': 1774714983.0, 'created_time': 1774607879.999749, 'last_price_update_time': 1774695621.091694}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW88691') HTTP/1.1" 204 0
2026-03-28 11:00:21 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.de] INFO: Scrape type for RE17232: 2
2026-03-28 11:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-28 11:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e455b8-884b-5ad9-9451-660113979c82, identifier: RE17232
2026-03-28 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-28 11:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-28 11:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232 to the API
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-28T16:50:17Z',
 'fuel_type': 'petrol',
 'id': '23e455b8-884b-5ad9-9451-660113979c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17232',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 98693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
 'transmission': 'automatic',
 'trim': 'T 4Matic+',
 'year': 2018}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.de] INFO: Saving data for RE17232: {'auction_closing_time': 1774716617.0, 'created_time': 1774349950.366438, 'last_price_update_time': 1774695621.667871}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17232') HTTP/1.1" 204 0
2026-03-28 11:00:21 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-28 11:00:21 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.de] INFO: Scrape type for UE30876: 2
2026-03-28 11:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-28 11:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05d164fa-902c-54bb-ab5a-f6903d939bc9, identifier: UE30876
2026-03-28 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-28 11:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-28 11:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876 to the API
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:14:10Z',
 'fuel_type': 'petrol',
 'id': '05d164fa-902c-54bb-ab5a-f6903d939bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE30876',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 84867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-14',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2012}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.de] INFO: Saving data for UE30876: {'auction_closing_time': 1774714450.0, 'created_time': 1774607542.583199, 'last_price_update_time': 1774695623.20441}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE30876') HTTP/1.1" 204 0
2026-03-28 11:00:23 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.de] INFO: Scrape type for DF69059: 2
2026-03-28 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-28 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 674728a0-6417-5cf5-9af8-cfd213d65b26 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 674728a0-6417-5cf5-9af8-cfd213d65b26 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 674728a0-6417-5cf5-9af8-cfd213d65b26, identifier: DF69059
2026-03-28 11:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-28 11:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-28 11:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059 to the API
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:25Z',
 'fuel_type': 'petrol',
 'id': '674728a0-6417-5cf5-9af8-cfd213d65b26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF69059',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 9380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.de] INFO: Saving data for DF69059: {'auction_closing_time': 1774717165.0, 'created_time': 1774607628.346798, 'last_price_update_time': 1774695623.748791}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF69059') HTTP/1.1" 204 0
2026-03-28 11:00:23 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9693 | hits on page: 40
2026-03-28 11:00:23 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 11:00:23 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 11:00:23 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.de] INFO: Scrape type for WG00954: 2
2026-03-28 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-28 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe462a8-b767-5b35-b861-127b922df1d7, identifier: WG00954
2026-03-28 11:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-28 11:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-28 11:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954 to the API
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:56:32Z',
 'fuel_type': 'petrol',
 'id': '6fe462a8-b767-5b35-b861-127b922df1d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00954',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 120213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2011}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.de] INFO: Saving data for WG00954: {'auction_closing_time': 1774716992.0, 'created_time': 1774607894.251306, 'last_price_update_time': 1774695624.253145}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG00954') HTTP/1.1" 204 0
2026-03-28 11:00:24 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 11:00:24 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 11:00:24 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.de] INFO: Scrape type for AU27688: 2
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5f1c75a-867e-5e74-b483-de1381e56f8e, identifier: AU27688
2026-03-28 11:00:24 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.de] INFO: Scrape type for ZK69536: 2
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e5d654-c934-59e0-8631-c7e648c17b03 with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e5d654-c934-59e0-8631-c7e648c17b03 with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0e5d654-c934-59e0-8631-c7e648c17b03, identifier: ZK69536
2026-03-28 11:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-28 11:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-28 11:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688 to the API
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:20:42Z',
 'fuel_type': 'petrol',
 'id': 'f5f1c75a-867e-5e74-b483-de1381e56f8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU27688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 228569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2013}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.de] INFO: Saving data for AU27688: {'auction_closing_time': 1774714842.0, 'created_time': 1774607545.020947, 'last_price_update_time': 1774695624.777004}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU27688') HTTP/1.1" 204 0
2026-03-28 11:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-28 11:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-28 11:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536 to the API
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': 'a0e5d654-c934-59e0-8631-c7e648c17b03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK69536',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 85958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.de] INFO: Saving data for ZK69536: {'auction_closing_time': 1774714335.0, 'created_time': 1774607715.167994, 'last_price_update_time': 1774695625.931613}
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK69536') HTTP/1.1" 204 0
2026-03-28 11:00:25 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-28 11:00:25 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.de] INFO: Scrape type for JU23189: 2
2026-03-28 11:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-28 11:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 2
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 2
2026-03-28 11:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3097a46a-39d6-5ef1-a1ae-9239be909dd1, identifier: JU23189
2026-03-28 11:00:26 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 11:00:26 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [auto1.de] INFO: Scrape type for BD44201: 2
2026-03-28 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-28 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-28 11:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69c631cc-a091-5d47-ac9c-8aad38f66977, identifier: BD44201
2026-03-28 11:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-28 11:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-28 11:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189 to the API
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:30:37Z',
 'fuel_type': 'petrol',
 'id': '3097a46a-39d6-5ef1-a1ae-9239be909dd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU23189',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 168144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [auto1.de] INFO: Saving data for JU23189: {'auction_closing_time': 1774715437.0, 'created_time': 1774607546.12803, 'last_price_update_time': 1774695626.508739}
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU23189') HTTP/1.1" 204 0
2026-03-28 11:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-28 11:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-28 11:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201 to the API
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:42:18Z',
 'fuel_type': 'diesel',
 'id': '69c631cc-a091-5d47-ac9c-8aad38f66977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD44201',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 89877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [auto1.de] INFO: Saving data for BD44201: {'auction_closing_time': 1774716138.0, 'created_time': 1773830655.282444, 'last_price_update_time': 1774695627.001319}
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD44201') HTTP/1.1" 204 0
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [auto1.de] INFO: Scrape type for LW83066: 2
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with scrape type 2
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with scrape type 2
2026-03-28 11:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d, identifier: LW83066
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 11:00:27 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [auto1.de] INFO: Scrape type for NG01563: 2
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724d67c5-f1e1-597f-acce-03782e26f701 with scrape type 2
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 724d67c5-f1e1-597f-acce-03782e26f701 with scrape type 2
2026-03-28 11:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 724d67c5-f1e1-597f-acce-03782e26f701, identifier: NG01563
2026-03-28 11:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-28 11:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-28 11:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066 to the API
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:24:11Z',
 'fuel_type': 'petrol',
 'id': '469fef8c-8a0a-54ee-a6ef-8e49d1498e8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW83066',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 46790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-14',
 'seller_name': None,
 'title': 'Kia Stonic 1.2 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2018}
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.de] INFO: Saving data for LW83066: {'auction_closing_time': 1774715051.0, 'created_time': 1774607627.93582, 'last_price_update_time': 1774695628.381037}
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW83066') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-28 11:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-28 11:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563 to the API
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:48:18Z',
 'fuel_type': 'petrol',
 'id': '724d67c5-f1e1-597f-acce-03782e26f701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG01563',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 169337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-21',
 'seller_name': None,
 'title': 'Saab 9-3 2.0 T Vector',
 'transmission': 'automatic',
 'trim': 'T Vector',
 'year': 2005}
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.de] INFO: Saving data for NG01563: {'auction_closing_time': 1774716498.0, 'created_time': 1774607540.946552, 'last_price_update_time': 1774695628.718268}
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG01563') HTTP/1.1" 204 0
2026-03-28 11:00:28 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.de] INFO: Scrape type for LX68947: 2
2026-03-28 11:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-28 11:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-28 11:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a660f3fb-e8b1-52c5-804a-a2b34b53e60e, identifier: LX68947
2026-03-28 11:00:28 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 11:00:28 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 11:00:28 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.de] INFO: Scrape type for XX11179: 2
2026-03-28 11:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-28 11:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea075bdd-3169-5676-9ecf-9541e96e4a78 with scrape type 2
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea075bdd-3169-5676-9ecf-9541e96e4a78 with scrape type 2
2026-03-28 11:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea075bdd-3169-5676-9ecf-9541e96e4a78, identifier: XX11179
2026-03-28 11:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-28 11:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-28 11:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947 to the API
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:02:53Z',
 'fuel_type': 'diesel',
 'id': 'a660f3fb-e8b1-52c5-804a-a2b34b53e60e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX68947',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 116520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-27',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Ghia X',
 'transmission': 'manual',
 'trim': 'Ghia X',
 'year': 2004}
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-28 11:00:29 [auto1.de] INFO: Saving data for LX68947: {'auction_closing_time': 1774713773.0, 'created_time': 1773302864.901384, 'last_price_update_time': 1774695629.954555}
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX68947') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-28 11:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-28 11:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179 to the API
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:20:48Z',
 'fuel_type': 'diesel',
 'id': 'ea075bdd-3169-5676-9ecf-9541e96e4a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX11179',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 243707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.de] INFO: Saving data for XX11179: {'auction_closing_time': 1774714848.0, 'created_time': 1774608060.630387, 'last_price_update_time': 1774695630.393648}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX11179') HTTP/1.1" 204 0
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.de] INFO: Scrape type for CT44889: 2
2026-03-28 11:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-28 11:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-28 11:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5beb08c1-c19d-5744-818a-a4472e905285, identifier: CT44889
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 11:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-28 11:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-28 11:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889 to the API
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:18Z',
 'fuel_type': 'petrol',
 'id': '5beb08c1-c19d-5744-818a-a4472e905285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT44889',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 149363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-14',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.de] INFO: Saving data for CT44889: {'auction_closing_time': 1774715178.0, 'created_time': 1774032781.380397, 'last_price_update_time': 1774695630.792629}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT44889') HTTP/1.1" 204 0
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 11:00:30 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.de] INFO: Scrape type for GS69685: 2
2026-03-28 11:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-28 11:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-28 11:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05059f83-d70d-53c8-a1a3-992f8729741f, identifier: GS69685
2026-03-28 11:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-28 11:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-28 11:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685 to the API
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:09Z',
 'fuel_type': 'petrol',
 'id': '05059f83-d70d-53c8-a1a3-992f8729741f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS69685',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 110483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-01',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.de] INFO: Saving data for GS69685: {'auction_closing_time': 1774716789.0, 'created_time': 1773306723.420779, 'last_price_update_time': 1774695631.620218}
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS69685') HTTP/1.1" 204 0
2026-03-28 11:00:31 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.de] INFO: Scrape type for AE12757: 2
2026-03-28 11:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-28 11:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with scrape type 2
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with scrape type 2
2026-03-28 11:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5afcd7-84b7-5df2-b91b-d574dc56f074, identifier: AE12757
2026-03-28 11:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-28 11:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-28 11:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757 to the API
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:04Z',
 'fuel_type': 'diesel',
 'id': '4a5afcd7-84b7-5df2-b91b-d574dc56f074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE12757',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 228944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.de] INFO: Saving data for AE12757: {'auction_closing_time': 1774713904.0, 'created_time': 1774607677.331957, 'last_price_update_time': 1774695632.05804}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE12757') HTTP/1.1" 204 0
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.de] INFO: Scrape type for NC61336: 2
2026-03-28 11:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-28 11:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a6a7a4-25da-57f9-8a5f-b8f397006911 with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a6a7a4-25da-57f9-8a5f-b8f397006911 with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02a6a7a4-25da-57f9-8a5f-b8f397006911, identifier: NC61336
2026-03-28 11:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-28 11:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-28 11:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336 to the API
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:24:12Z',
 'fuel_type': 'petrol',
 'id': '02a6a7a4-25da-57f9-8a5f-b8f397006911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC61336',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 111812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.de] INFO: Saving data for NC61336: {'auction_closing_time': 1774715052.0, 'created_time': 1774607667.747568, 'last_price_update_time': 1774695632.449931}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC61336') HTTP/1.1" 204 0
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 11:00:32 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.de] INFO: Scrape type for CK79873: 2
2026-03-28 11:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-28 11:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe047b51-72f5-552c-84ed-2f45b2927b3c, identifier: CK79873
2026-03-28 11:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-28 11:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-28 11:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873 to the API
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': 'fe047b51-72f5-552c-84ed-2f45b2927b3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK79873',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 193061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.de] INFO: Saving data for CK79873: {'auction_closing_time': 1774715595.0, 'created_time': 1774607717.798057, 'last_price_update_time': 1774695632.909737}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK79873') HTTP/1.1" 204 0
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.de] INFO: Scrape type for MV69505: 2
2026-03-28 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-28 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7264d6f-1a5e-58d9-a331-975c677af46b, identifier: MV69505
2026-03-28 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-28 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-28 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505 to the API
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:38Z',
 'fuel_type': 'diesel',
 'id': 'f7264d6f-1a5e-58d9-a331-975c677af46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV69505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 72898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.de] INFO: Saving data for MV69505: {'auction_closing_time': 1774717178.0, 'created_time': 1774607623.476868, 'last_price_update_time': 1774695633.422634}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV69505') HTTP/1.1" 204 0
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.de] INFO: Scrape type for KS26285: 2
2026-03-28 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-28 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe3bd58-ac24-5d19-984d-7a9f503563cb, identifier: KS26285
2026-03-28 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-28 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-28 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285 to the API
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:51:13Z',
 'fuel_type': 'diesel',
 'id': '2fe3bd58-ac24-5d19-984d-7a9f503563cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS26285',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 140947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.de] INFO: Saving data for KS26285: {'auction_closing_time': 1774716673.0, 'created_time': 1774607618.889081, 'last_price_update_time': 1774695633.813016}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS26285') HTTP/1.1" 204 0
2026-03-28 11:00:33 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.de] INFO: Scrape type for NH03698: 2
2026-03-28 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-28 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f, identifier: NH03698
2026-03-28 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-28 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-28 11:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698 to the API
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:15Z',
 'fuel_type': 'petrol',
 'id': 'ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH03698',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 8713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-28',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Extreme',
 'transmission': 'manual',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.de] INFO: Saving data for NH03698: {'auction_closing_time': 1774716135.0, 'created_time': 1774607616.161976, 'last_price_update_time': 1774695634.21279}
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH03698') HTTP/1.1" 204 0
2026-03-28 11:00:34 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.de] INFO: Scrape type for SC33158: 2
2026-03-28 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-28 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375dca87-70ca-5f77-aa3b-54fdb580b67c with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 375dca87-70ca-5f77-aa3b-54fdb580b67c with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 375dca87-70ca-5f77-aa3b-54fdb580b67c, identifier: SC33158
2026-03-28 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-28 11:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-28 11:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158 to the API
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'petrol',
 'id': '375dca87-70ca-5f77-aa3b-54fdb580b67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC33158',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 65980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-12',
 'seller_name': None,
 'title': 'Porsche 911 996 Carrera',
 'transmission': 'manual',
 'trim': 'Carrera',
 'year': 2004}
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.de] INFO: Saving data for SC33158: {'auction_closing_time': 1774715579.0, 'created_time': 1774607617.498983, 'last_price_update_time': 1774695634.732897}
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC33158') HTTP/1.1" 204 0
2026-03-28 11:00:34 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.de] INFO: Scrape type for WY54008: 2
2026-03-28 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-28 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eefa11ee-9875-5b77-958f-dd4205007831, identifier: WY54008
2026-03-28 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-28 11:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-28 11:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008 to the API
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'petrol',
 'id': 'eefa11ee-9875-5b77-958f-dd4205007831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY54008',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 137484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.de] INFO: Saving data for WY54008: {'auction_closing_time': 1774716511.0, 'created_time': 1774607612.336476, 'last_price_update_time': 1774695635.187906}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY54008') HTTP/1.1" 204 0
2026-03-28 11:00:35 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.de] INFO: Scrape type for WE78461: 2
2026-03-28 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-28 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2649402-d15a-58da-8f45-22e6df2d71eb, identifier: WE78461
2026-03-28 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-28 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-28 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461 to the API
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:21Z',
 'fuel_type': 'diesel',
 'id': 'd2649402-d15a-58da-8f45-22e6df2d71eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE78461',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.de] INFO: Saving data for WE78461: {'auction_closing_time': 1774717041.0, 'created_time': 1774607624.516571, 'last_price_update_time': 1774695635.589028}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE78461') HTTP/1.1" 204 0
2026-03-28 11:00:35 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9693 | hits on page: 40
2026-03-28 11:00:35 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.de] INFO: Scrape type for XX31314: 2
2026-03-28 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-28 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929769ef-7a25-57f3-bcc9-86c4e988916c with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 929769ef-7a25-57f3-bcc9-86c4e988916c with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 929769ef-7a25-57f3-bcc9-86c4e988916c, identifier: XX31314
2026-03-28 11:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-28 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-28 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314 to the API
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:00:42Z',
 'fuel_type': 'petrol',
 'id': '929769ef-7a25-57f3-bcc9-86c4e988916c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX31314',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 32274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2024}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Saving data for XX31314: {'auction_closing_time': 1774713642.0, 'created_time': 1774607625.671864, 'last_price_update_time': 1774695636.048306}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX31314') HTTP/1.1" 204 0
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Scrape type for UK16576: 2
2026-03-28 11:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-28 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254deee2-96fb-5ddf-803a-b30cfd31c70f with scrape type 2
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254deee2-96fb-5ddf-803a-b30cfd31c70f with scrape type 2
2026-03-28 11:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 254deee2-96fb-5ddf-803a-b30cfd31c70f, identifier: UK16576
2026-03-28 11:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-28 11:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-28 11:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576 to the API
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-28T16:26:16Z',
 'fuel_type': 'diesel',
 'id': '254deee2-96fb-5ddf-803a-b30cfd31c70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK16576',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 22335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-26',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2025}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Saving data for UK16576: {'auction_closing_time': 1774715176.0, 'created_time': 1774607629.295932, 'last_price_update_time': 1774695636.490752}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK16576') HTTP/1.1" 204 0
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Scrape type for HL17570: 2
2026-03-28 11:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-28 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with scrape type 2
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with scrape type 2
2026-03-28 11:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611, identifier: HL17570
2026-03-28 11:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-28 11:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-28 11:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570 to the API
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:16:06Z',
 'fuel_type': 'petrol',
 'id': 'd421f7bd-1b5a-5bd2-9fd9-1bd19eebd611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL17570',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 17192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-25',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech MAX',
 'transmission': 'manual',
 'trim': 'MAX',
 'year': 2025}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Saving data for HL17570: {'auction_closing_time': 1774714566.0, 'created_time': 1774607632.140542, 'last_price_update_time': 1774695636.926151}
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL17570') HTTP/1.1" 204 0
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-28 11:00:36 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.de] INFO: Scrape type for KP27245: 2
2026-03-28 11:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-28 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 2
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 2
2026-03-28 11:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612708e7-8aa9-5dc5-a611-84b01b85751b, identifier: KP27245
2026-03-28 11:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-28 11:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-28 11:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245 to the API
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:37:32Z',
 'fuel_type': 'diesel',
 'id': '612708e7-8aa9-5dc5-a611-84b01b85751b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP27245',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 105065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Saving data for KP27245: {'auction_closing_time': 1774715852.0, 'created_time': 1774607680.520626, 'last_price_update_time': 1774695637.361275}
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP27245') HTTP/1.1" 204 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for LF68869: 2
2026-03-28 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-28 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with scrape type 2
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with scrape type 2
2026-03-28 11:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6, identifier: LF68869
2026-03-28 11:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-28 11:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-28 11:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869 to the API
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:59Z',
 'fuel_type': 'petrol',
 'id': '0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF68869',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 177784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-11',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Edition',
 'transmission': 'manual',
 'trim': 'Compact Edition',
 'year': 2006}
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Saving data for LF68869: {'auction_closing_time': 1774716179.0, 'created_time': 1774607623.862005, 'last_price_update_time': 1774695637.916743}
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF68869') HTTP/1.1" 204 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for HF06660: 2
2026-03-28 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-28 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 2
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 2
2026-03-28 11:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57aa10a7-6db1-545d-a03e-a3af09cabb59, identifier: HF06660
2026-03-28 11:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-28 11:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-28 11:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660 to the API
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:35:17Z',
 'fuel_type': 'petrol',
 'id': '57aa10a7-6db1-545d-a03e-a3af09cabb59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF06660',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 72681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2020}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Saving data for HF06660: {'auction_closing_time': 1774715717.0, 'created_time': 1774607627.149307, 'last_price_update_time': 1774695638.383392}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF06660') HTTP/1.1" 204 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for GY26864: 2
2026-03-28 11:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-28 11:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-28 11:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7882e127-1b01-5045-8bef-b3bb50b2c615, identifier: GY26864
2026-03-28 11:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-28 11:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-28 11:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864 to the API
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:19:44Z',
 'fuel_type': 'petrol',
 'id': '7882e127-1b01-5045-8bef-b3bb50b2c615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY26864',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 145492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Saving data for GY26864: {'auction_closing_time': 1774714784.0, 'created_time': 1773226949.831073, 'last_price_update_time': 1774695638.827563}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY26864') HTTP/1.1" 204 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for JL47940: 2
2026-03-28 11:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-28 11:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with scrape type 2
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with scrape type 2
2026-03-28 11:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b12afdfb-a057-5f57-bd1c-b5c68901f4b5, identifier: JL47940
2026-03-28 11:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-28 11:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-28 11:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940 to the API
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:54Z',
 'fuel_type': 'petrol',
 'id': 'b12afdfb-a057-5f57-bd1c-b5c68901f4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL47940',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-23',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [auto1.de] INFO: Saving data for JL47940: {'auction_closing_time': 1774716534.0, 'created_time': 1774607631.600559, 'last_price_update_time': 1774695639.301336}
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL47940') HTTP/1.1" 204 0
2026-03-28 11:00:39 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [auto1.de] INFO: Scrape type for VT76935: 2
2026-03-28 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-28 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 2
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 2
2026-03-28 11:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e37bf0ce-5ada-5e23-93e6-46c5e633e60d, identifier: VT76935
2026-03-28 11:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-28 11:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-28 11:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935 to the API
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:19:45Z',
 'fuel_type': 'petrol',
 'id': 'e37bf0ce-5ada-5e23-93e6-46c5e633e60d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT76935',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 129056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [auto1.de] INFO: Saving data for VT76935: {'auction_closing_time': 1774714785.0, 'created_time': 1774607671.781345, 'last_price_update_time': 1774695639.716334}
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT76935') HTTP/1.1" 204 0
2026-03-28 11:00:39 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [auto1.de] INFO: Scrape type for ZD23716: 2
2026-03-28 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-28 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 263f08e8-a9d3-54e0-a966-ccd267923967 with scrape type 2
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 263f08e8-a9d3-54e0-a966-ccd267923967 with scrape type 2
2026-03-28 11:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 263f08e8-a9d3-54e0-a966-ccd267923967, identifier: ZD23716
2026-03-28 11:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-28 11:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-28 11:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716 to the API
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:41Z',
 'fuel_type': 'diesel',
 'id': '263f08e8-a9d3-54e0-a966-ccd267923967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD23716',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 154895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2014}
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [auto1.de] INFO: Saving data for ZD23716: {'auction_closing_time': 1774715861.0, 'created_time': 1774607626.546128, 'last_price_update_time': 1774695640.251487}
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD23716') HTTP/1.1" 204 0
2026-03-28 11:00:40 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [auto1.de] INFO: Scrape type for ZG00412: 2
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-28 11:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 703f9153-187e-5475-b1d0-35832e3679b3, identifier: ZG00412
2026-03-28 11:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-28 11:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-28 11:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412 to the API
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:35:00Z',
 'fuel_type': 'diesel',
 'id': '703f9153-187e-5475-b1d0-35832e3679b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG00412',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 94794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [auto1.de] INFO: Saving data for ZG00412: {'auction_closing_time': 1774715700.0, 'created_time': 1774002196.112133, 'last_price_update_time': 1774695640.703313}
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG00412') HTTP/1.1" 204 0
2026-03-28 11:00:40 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [auto1.de] INFO: Scrape type for XL45586: 2
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-28 11:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8157fd3e-fd37-5c06-b9bd-57338cef12dd, identifier: XL45586
2026-03-28 11:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-28 11:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-28 11:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586 to the API
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:15:26Z',
 'fuel_type': 'petrol',
 'id': '8157fd3e-fd37-5c06-b9bd-57338cef12dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL45586',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 139797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi S6 4.0 V8 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.de] INFO: Saving data for XL45586: {'auction_closing_time': 1774714526.0, 'created_time': 1772543201.677041, 'last_price_update_time': 1774695641.140262}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL45586') HTTP/1.1" 204 0
2026-03-28 11:00:41 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.de] INFO: Scrape type for MC50567: 2
2026-03-28 11:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-28 11:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 2
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 2
2026-03-28 11:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b504f5ac-fce6-5635-92ee-8eb589c7cdcf, identifier: MC50567
2026-03-28 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-28 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-28 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567 to the API
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:16:45Z',
 'fuel_type': 'petrol',
 'id': 'b504f5ac-fce6-5635-92ee-8eb589c7cdcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC50567',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 22242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-16',
 'seller_name': None,
 'title': 'Jeep Renegade 1.5 GSE T4 e-Hybrid Longitude FWD',
 'transmission': 'automatic',
 'trim': 'Longitude FWD',
 'year': 2023}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.de] INFO: Saving data for MC50567: {'auction_closing_time': 1774714605.0, 'created_time': 1774607651.843726, 'last_price_update_time': 1774695641.580792}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC50567') HTTP/1.1" 204 0
2026-03-28 11:00:41 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-28 11:00:41 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.de] INFO: Scrape type for MK74159: 2
2026-03-28 11:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-28 11:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 2
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 2
2026-03-28 11:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b328be0f-faf5-54e8-abc9-06a3d8c84d10, identifier: MK74159
2026-03-28 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-28 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-28 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159 to the API
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:11:55Z',
 'fuel_type': 'petrol',
 'id': 'b328be0f-faf5-54e8-abc9-06a3d8c84d10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK74159',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 194088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-06',
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8 Bblue',
 'transmission': 'manual',
 'trim': 'Bblue',
 'year': 2003}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.de] INFO: Saving data for MK74159: {'auction_closing_time': 1774714315.0, 'created_time': 1774607644.142176, 'last_price_update_time': 1774695641.990057}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK74159') HTTP/1.1" 204 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for JZ96778: 2
2026-03-28 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-28 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ced0e941-4b30-58ce-865e-e5008967fd8f, identifier: JZ96778
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-28 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-28 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778 to the API
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:55:40Z',
 'fuel_type': 'diesel',
 'id': 'ced0e941-4b30-58ce-865e-e5008967fd8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ96778',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 243132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2012}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Saving data for JZ96778: {'auction_closing_time': 1774716940.0, 'created_time': 1774607648.338541, 'last_price_update_time': 1774695642.396639}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ96778') HTTP/1.1" 204 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for GB74339: 2
2026-03-28 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-28 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d, identifier: GB74339
2026-03-28 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-28 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-28 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339 to the API
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:35:35Z',
 'fuel_type': 'petrol',
 'id': '3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB74339',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 48990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-16',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Platinum Edition',
 'transmission': 'manual',
 'trim': 'Platinum Edition',
 'year': 2018}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Saving data for GB74339: {'auction_closing_time': 1774715735.0, 'created_time': 1774607860.637799, 'last_price_update_time': 1774695642.854394}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB74339') HTTP/1.1" 204 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for YS13064: 2
2026-03-28 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-28 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 2
2026-03-28 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1d0c80b-d4ae-5cc4-a782-626d2367a789, identifier: YS13064
2026-03-28 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-28 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-28 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064 to the API
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:20:54Z',
 'fuel_type': 'petrol',
 'id': 'd1d0c80b-d4ae-5cc4-a782-626d2367a789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS13064',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 98483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-30',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2012}
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.de] INFO: Saving data for YS13064: {'auction_closing_time': 1774714854.0, 'created_time': 1774607860.201718, 'last_price_update_time': 1774695643.280883}
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS13064') HTTP/1.1" 204 0
2026-03-28 11:00:43 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9694 | hits on page: 40
2026-03-28 11:00:43 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.de] INFO: Scrape type for DW23670: 2
2026-03-28 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-28 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 2
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 2
2026-03-28 11:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09229703-dce0-55c9-9182-c8b672313250, identifier: DW23670
2026-03-28 11:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-28 11:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-28 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670 to the API
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:21:59Z',
 'fuel_type': 'diesel',
 'id': '09229703-dce0-55c9-9182-c8b672313250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW23670',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 50519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.de] INFO: Saving data for DW23670: {'auction_closing_time': 1774714919.0, 'created_time': 1774607676.978056, 'last_price_update_time': 1774695643.781895}
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW23670') HTTP/1.1" 204 0
2026-03-28 11:00:43 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 11:00:43 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.de] INFO: Scrape type for GB59587: 2
2026-03-28 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-28 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 2
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 2
2026-03-28 11:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12903823-e98d-5fff-a95d-ef898ad9f779, identifier: GB59587
2026-03-28 11:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:43 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.de] INFO: Scrape type for TL45864: 2
2026-03-28 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-28 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with scrape type 2
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with scrape type 2
2026-03-28 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9912a6b1-651e-56a7-ba17-8ee1a975cea1, identifier: TL45864
2026-03-28 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-28 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-28 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587 to the API
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:40:37Z',
 'fuel_type': 'diesel',
 'id': '12903823-e98d-5fff-a95d-ef898ad9f779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB59587',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 93177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [auto1.de] INFO: Saving data for GB59587: {'auction_closing_time': 1774716037.0, 'created_time': 1774607699.442725, 'last_price_update_time': 1774695644.325531}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB59587') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-28 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-28 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864 to the API
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:59Z',
 'fuel_type': 'petrol',
 'id': '9912a6b1-651e-56a7-ba17-8ee1a975cea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL45864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 100299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [auto1.de] INFO: Saving data for TL45864: {'auction_closing_time': 1774714859.0, 'created_time': 1774607640.727272, 'last_price_update_time': 1774695644.642302}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL45864') HTTP/1.1" 204 0
2026-03-28 11:00:44 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-28 11:00:44 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [auto1.de] INFO: Scrape type for FX80624: 2
2026-03-28 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-28 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-28 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e24b636-5475-51f6-984d-8436e3a131d2, identifier: FX80624
2026-03-28 11:00:44 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 11:00:44 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [auto1.de] INFO: Scrape type for BE44691: 2
2026-03-28 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-28 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 2
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 2
2026-03-28 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0432bc-4c9b-536f-b039-9859227085e4, identifier: BE44691
2026-03-28 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-28 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-28 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624 to the API
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:11:39Z',
 'fuel_type': 'diesel',
 'id': '1e24b636-5475-51f6-984d-8436e3a131d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX80624',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 160568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [auto1.de] INFO: Saving data for FX80624: {'auction_closing_time': 1774714299.0, 'created_time': 1773945872.686088, 'last_price_update_time': 1774695645.15868}
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX80624') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-28 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-28 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691 to the API
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:38Z',
 'fuel_type': 'petrol',
 'id': 'fe0432bc-4c9b-536f-b039-9859227085e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE44691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 99478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [auto1.de] INFO: Saving data for BE44691: {'auction_closing_time': 1774717178.0, 'created_time': 1774607651.424672, 'last_price_update_time': 1774695645.454714}
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE44691') HTTP/1.1" 204 0
2026-03-28 11:00:45 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [auto1.de] INFO: Scrape type for AF42457: 2
2026-03-28 11:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-28 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-28 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97, identifier: AF42457
2026-03-28 11:00:45 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [auto1.de] INFO: Scrape type for JM99769: 2
2026-03-28 11:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-28 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 2
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 2
2026-03-28 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02acfc2-5aee-56b6-b9c8-5a8782c753c8, identifier: JM99769
2026-03-28 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-28 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-28 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457 to the API
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:35:42Z',
 'fuel_type': 'diesel',
 'id': '04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF42457',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 269135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-20',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2014}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.de] INFO: Saving data for AF42457: {'auction_closing_time': 1774715742.0, 'created_time': 1774349774.413642, 'last_price_update_time': 1774695646.009276}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF42457') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-28 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-28 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769 to the API
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:57:59Z',
 'fuel_type': 'diesel',
 'id': 'f02acfc2-5aee-56b6-b9c8-5a8782c753c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM99769',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 350351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-09',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.de] INFO: Saving data for JM99769: {'auction_closing_time': 1774717079.0, 'created_time': 1774607625.25785, 'last_price_update_time': 1774695646.32259}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM99769') HTTP/1.1" 204 0
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.de] INFO: Scrape type for ES42650: 2
2026-03-28 11:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-28 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-28 11:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73380efc-b2b9-51d6-a886-aa1de7481157, identifier: ES42650
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-28 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-28 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650 to the API
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:52:05Z',
 'fuel_type': 'petrol',
 'id': '73380efc-b2b9-51d6-a886-aa1de7481157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES42650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 119463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.de] INFO: Saving data for ES42650: {'auction_closing_time': 1774716725.0, 'created_time': 1773830834.98912, 'last_price_update_time': 1774695646.730161}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES42650') HTTP/1.1" 204 0
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 11:00:46 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.de] INFO: Scrape type for EA13561: 2
2026-03-28 11:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-28 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 2
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 2
2026-03-28 11:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0e39d28-937d-54ff-a131-ab56b06a77ab, identifier: EA13561
2026-03-28 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-28 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-28 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561 to the API
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'petrol',
 'id': 'd0e39d28-937d-54ff-a131-ab56b06a77ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA13561',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 30261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-20',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Max',
 'transmission': 'automatic',
 'trim': 'Max',
 'year': 2023}
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [auto1.de] INFO: Saving data for EA13561: {'auction_closing_time': 1774713704.0, 'created_time': 1774607696.282242, 'last_price_update_time': 1774695647.222818}
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA13561') HTTP/1.1" 204 0
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [auto1.de] INFO: Scrape type for GH02109: 2
2026-03-28 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-28 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 2
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 2
2026-03-28 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ec27e1a-c227-5dad-b824-0d399b539a74, identifier: GH02109
2026-03-28 11:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-28 11:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-28 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109 to the API
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:34Z',
 'fuel_type': 'diesel',
 'id': '2ec27e1a-c227-5dad-b824-0d399b539a74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH02109',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 153373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [auto1.de] INFO: Saving data for GH02109: {'auction_closing_time': 1774716634.0, 'created_time': 1774607675.742035, 'last_price_update_time': 1774695647.609421}
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH02109') HTTP/1.1" 204 0
2026-03-28 11:00:47 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [auto1.de] INFO: Scrape type for TR96754: 2
2026-03-28 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-28 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39892cdc-c5a9-5146-8e08-9c537b08567e with scrape type 2
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39892cdc-c5a9-5146-8e08-9c537b08567e with scrape type 2
2026-03-28 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39892cdc-c5a9-5146-8e08-9c537b08567e, identifier: TR96754
2026-03-28 11:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-28 11:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-28 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754 to the API
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:00:00Z',
 'fuel_type': 'diesel',
 'id': '39892cdc-c5a9-5146-8e08-9c537b08567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR96754',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 100155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [auto1.de] INFO: Saving data for TR96754: {'auction_closing_time': 1774713600.0, 'created_time': 1774607696.67057, 'last_price_update_time': 1774695648.027239}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR96754') HTTP/1.1" 204 0
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [auto1.de] INFO: Scrape type for SS89253: 2
2026-03-28 11:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-28 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-28 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 236cca1f-c6f8-590b-b5ab-ba94fa420791, identifier: SS89253
2026-03-28 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-28 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-28 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253 to the API
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:54:17Z',
 'fuel_type': 'diesel',
 'id': '236cca1f-c6f8-590b-b5ab-ba94fa420791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89253',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 103162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [auto1.de] INFO: Saving data for SS89253: {'auction_closing_time': 1774716857.0, 'created_time': 1773345363.901135, 'last_price_update_time': 1774695648.461195}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS89253') HTTP/1.1" 204 0
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [auto1.de] INFO: Scrape type for JN13946: 2
2026-03-28 11:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-28 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-28 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8, identifier: JN13946
2026-03-28 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-28 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-28 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946 to the API
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:08Z',
 'fuel_type': 'petrol',
 'id': '9dd1b142-46ab-5d6d-83d1-f944a52c4dc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN13946',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 144763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2004}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [auto1.de] INFO: Saving data for JN13946: {'auction_closing_time': 1774713908.0, 'created_time': 1774002840.940945, 'last_price_update_time': 1774695648.862261}
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN13946') HTTP/1.1" 204 0
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 11:00:48 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.de] INFO: Scrape type for PV56207: 2
2026-03-28 11:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-28 11:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 2
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 2
2026-03-28 11:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb22af45-881f-5892-a577-6abd03dacda0, identifier: PV56207
2026-03-28 11:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-28 11:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-28 11:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207 to the API
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:07:12Z',
 'fuel_type': 'diesel',
 'id': 'cb22af45-881f-5892-a577-6abd03dacda0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV56207',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 361677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-08',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 Turbodiesel Spezial',
 'transmission': 'manual',
 'trim': 'Spezial',
 'year': 2001}
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.de] INFO: Saving data for PV56207: {'auction_closing_time': 1774714032.0, 'created_time': 1774607664.433637, 'last_price_update_time': 1774695649.443756}
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV56207') HTTP/1.1" 204 0
2026-03-28 11:00:49 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.de] INFO: Scrape type for JS13151: 2
2026-03-28 11:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-28 11:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 2
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 2
2026-03-28 11:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d42e471d-29d6-5e33-9d9d-5152535fa1a9, identifier: JS13151
2026-03-28 11:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-28 11:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-28 11:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151 to the API
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:43:04Z',
 'fuel_type': 'petrol',
 'id': 'd42e471d-29d6-5e33-9d9d-5152535fa1a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS13151',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 38452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-12',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2023}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Saving data for JS13151: {'auction_closing_time': 1774716184.0, 'created_time': 1774607679.821267, 'last_price_update_time': 1774695650.375696}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS13151') HTTP/1.1" 204 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for WR99181: 2
2026-03-28 11:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-28 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 2
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 2
2026-03-28 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612a6b31-5044-57df-a10e-0a9b2401b357, identifier: WR99181
2026-03-28 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-28 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-28 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181 to the API
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:32:49Z',
 'fuel_type': 'petrol',
 'id': '612a6b31-5044-57df-a10e-0a9b2401b357',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR99181',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 109774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-31',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis pure',
 'transmission': 'automatic',
 'trim': 'Basis pure',
 'year': 2005}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Saving data for WR99181: {'auction_closing_time': 1774715569.0, 'created_time': 1774607679.08843, 'last_price_update_time': 1774695650.7795}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR99181') HTTP/1.1" 204 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for VT05460: 2
2026-03-28 11:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-28 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3098c60f-f7e5-5f22-92b1-f404aca20a4b with scrape type 2
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3098c60f-f7e5-5f22-92b1-f404aca20a4b with scrape type 2
2026-03-28 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3098c60f-f7e5-5f22-92b1-f404aca20a4b, identifier: VT05460
2026-03-28 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-28 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-28 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460 to the API
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:18:40Z',
 'fuel_type': 'diesel',
 'id': '3098c60f-f7e5-5f22-92b1-f404aca20a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT05460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 144641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [auto1.de] INFO: Saving data for VT05460: {'auction_closing_time': 1774714720.0, 'created_time': 1774032313.540244, 'last_price_update_time': 1774695651.236699}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT05460') HTTP/1.1" 204 0
2026-03-28 11:00:51 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [auto1.de] INFO: Scrape type for LV46830: 2
2026-03-28 11:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-28 11:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 2
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 2
2026-03-28 11:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff, identifier: LV46830
2026-03-28 11:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-28 11:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-28 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830 to the API
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:37:02Z',
 'fuel_type': 'petrol',
 'id': '776ee6ce-a36f-5af4-b35f-51c5d3d387ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV46830',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 83825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [auto1.de] INFO: Saving data for LV46830: {'auction_closing_time': 1774715822.0, 'created_time': 1774607910.572714, 'last_price_update_time': 1774695651.662422}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV46830') HTTP/1.1" 204 0
2026-03-28 11:00:51 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [auto1.de] INFO: Scrape type for SJ46577: 2
2026-03-28 11:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-28 11:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with scrape type 2
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with scrape type 2
2026-03-28 11:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b, identifier: SJ46577
2026-03-28 11:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-28 11:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-28 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577 to the API
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:28:28Z',
 'fuel_type': 'diesel',
 'id': '6529c2c3-46b8-5cc7-9a3d-02451a5be90b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ46577',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 101770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2023}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.de] INFO: Saving data for SJ46577: {'auction_closing_time': 1774715308.0, 'created_time': 1774607748.706452, 'last_price_update_time': 1774695652.090907}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ46577') HTTP/1.1" 204 0
2026-03-28 11:00:52 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 11:00:52 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.de] INFO: Scrape type for FE22716: 2
2026-03-28 11:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-28 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-28 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e4b5d2-d01e-5883-9a4c-4d9267968632, identifier: FE22716
2026-03-28 11:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-28 11:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-28 11:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716 to the API
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:15Z',
 'fuel_type': 'diesel',
 'id': '19e4b5d2-d01e-5883-9a4c-4d9267968632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE22716',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 218551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-07',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2012}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.de] INFO: Saving data for FE22716: {'auction_closing_time': 1774715655.0, 'created_time': 1774032081.666348, 'last_price_update_time': 1774695652.533491}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE22716') HTTP/1.1" 204 0
2026-03-28 11:00:52 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.de] INFO: Scrape type for VM88719: 2
2026-03-28 11:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-28 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdd0925-1030-5135-b202-7815fa866981 with scrape type 2
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbdd0925-1030-5135-b202-7815fa866981 with scrape type 2
2026-03-28 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbdd0925-1030-5135-b202-7815fa866981, identifier: VM88719
2026-03-28 11:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-28 11:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-28 11:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719 to the API
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:31:55Z',
 'fuel_type': 'petrol',
 'id': 'fbdd0925-1030-5135-b202-7815fa866981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM88719',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 95796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.de] INFO: Saving data for VM88719: {'auction_closing_time': 1774715515.0, 'created_time': 1774607796.292279, 'last_price_update_time': 1774695652.95074}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM88719') HTTP/1.1" 204 0
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.de] INFO: Scrape type for YV97613: 2
2026-03-28 11:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-28 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with scrape type 2
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with scrape type 2
2026-03-28 11:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1275aaaa-ca9c-5168-85c7-e13a5f66e419, identifier: YV97613
2026-03-28 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-28 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-28 11:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613 to the API
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:07:50Z',
 'fuel_type': 'diesel',
 'id': '1275aaaa-ca9c-5168-85c7-e13a5f66e419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV97613',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 162873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.2 Diesel D LTZ 4WD',
 'transmission': 'automatic',
 'trim': 'D LTZ 4WD',
 'year': 2011}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.de] INFO: Saving data for YV97613: {'auction_closing_time': 1774714070.0, 'created_time': 1774607710.286563, 'last_price_update_time': 1774695653.476797}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV97613') HTTP/1.1" 204 0
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.de] INFO: Scrape type for PT90816: 2
2026-03-28 11:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-28 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 2
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 2
2026-03-28 11:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923, identifier: PT90816
2026-03-28 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-28 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-28 11:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816 to the API
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'diesel',
 'id': '7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT90816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 214177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-13',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.de] INFO: Saving data for PT90816: {'auction_closing_time': 1774715107.0, 'created_time': 1774607716.469401, 'last_price_update_time': 1774695653.920466}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT90816') HTTP/1.1" 204 0
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 11:00:53 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.de] INFO: Scrape type for JY33610: 2
2026-03-28 11:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-28 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 2
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 2
2026-03-28 11:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51, identifier: JY33610
2026-03-28 11:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-28 11:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-28 11:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610 to the API
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'diesel',
 'id': 'b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY33610',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 101289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean Edition 4Motion',
 'transmission': 'automatic',
 'trim': 'Ocean Edition 4Motion',
 'year': 2020}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-28 11:00:54 [auto1.de] INFO: Saving data for JY33610: {'auction_closing_time': 1774715601.0, 'created_time': 1774607709.888909, 'last_price_update_time': 1774695654.379675}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY33610') HTTP/1.1" 204 0
2026-03-28 11:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:55 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9694 | hits on page: 40
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.de] INFO: Scrape type for DW75956: 2
2026-03-28 11:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-28 11:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-28 11:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a090868e-41c7-51ba-ab0d-3328efc78207, identifier: DW75956
2026-03-28 11:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-28 11:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-28 11:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956 to the API
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:59:54Z',
 'fuel_type': 'diesel',
 'id': 'a090868e-41c7-51ba-ab0d-3328efc78207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW75956',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 138817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.de] INFO: Saving data for DW75956: {'auction_closing_time': 1774717194.0, 'created_time': 1773226019.331426, 'last_price_update_time': 1774695655.824102}
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW75956') HTTP/1.1" 204 0
2026-03-28 11:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 11:00:55 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.de] INFO: Scrape type for JT94626: 2
2026-03-28 11:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-28 11:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac696a5-0f5d-5b48-a71b-7b7370cea606 with scrape type 2
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac696a5-0f5d-5b48-a71b-7b7370cea606 with scrape type 2
2026-03-28 11:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac696a5-0f5d-5b48-a71b-7b7370cea606, identifier: JT94626
2026-03-28 11:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-28 11:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-28 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626 to the API
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:38:41Z',
 'fuel_type': 'petrol',
 'id': 'aac696a5-0f5d-5b48-a71b-7b7370cea606',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT94626',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 129958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 280 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2012}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [auto1.de] INFO: Saving data for JT94626: {'auction_closing_time': 1774715921.0, 'created_time': 1774607685.605237, 'last_price_update_time': 1774695656.230758}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT94626') HTTP/1.1" 204 0
2026-03-28 11:00:56 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [auto1.de] INFO: Scrape type for XK99060: 2
2026-03-28 11:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-28 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5853aa09-134f-535f-a047-c4db9b75a0b9 with scrape type 2
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5853aa09-134f-535f-a047-c4db9b75a0b9 with scrape type 2
2026-03-28 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5853aa09-134f-535f-a047-c4db9b75a0b9, identifier: XK99060
2026-03-28 11:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-28 11:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-28 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060 to the API
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:03:25Z',
 'fuel_type': 'petrol',
 'id': '5853aa09-134f-535f-a047-c4db9b75a0b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK99060',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 41400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2019}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [auto1.de] INFO: Saving data for XK99060: {'auction_closing_time': 1774713805.0, 'created_time': 1774607698.921852, 'last_price_update_time': 1774695656.749725}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK99060') HTTP/1.1" 204 0
2026-03-28 11:00:56 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 11:00:56 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 11:00:56 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [auto1.de] INFO: Scrape type for SA10285: 2
2026-03-28 11:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-28 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 2
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 2
2026-03-28 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627, identifier: SA10285
2026-03-28 11:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-28 11:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-28 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285 to the API
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:52:16Z',
 'fuel_type': 'diesel',
 'id': '9f5075c7-b95d-56f6-a9c9-1e5a345a4627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA10285',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 51703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2024}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [auto1.de] INFO: Saving data for SA10285: {'auction_closing_time': 1774716736.0, 'created_time': 1774607690.565374, 'last_price_update_time': 1774695657.18029}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA10285') HTTP/1.1" 204 0
2026-03-28 11:00:57 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 11:00:57 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [auto1.de] INFO: Scrape type for EN90928: 2
2026-03-28 11:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-28 11:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-28 11:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1156df4f-c722-5115-9af4-73ce3228f788, identifier: EN90928
2026-03-28 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-28 11:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-28 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928 to the API
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'diesel',
 'id': '1156df4f-c722-5115-9af4-73ce3228f788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN90928',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 96705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [auto1.de] INFO: Saving data for EN90928: {'auction_closing_time': 1774715601.0, 'created_time': 1774034104.837985, 'last_price_update_time': 1774695657.60808}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN90928') HTTP/1.1" 204 0
2026-03-28 11:00:57 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [auto1.de] INFO: Scrape type for LA44092: 2
2026-03-28 11:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-28 11:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7624d114-9828-5d79-866c-1581d325b944 with scrape type 2
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7624d114-9828-5d79-866c-1581d325b944 with scrape type 2
2026-03-28 11:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7624d114-9828-5d79-866c-1581d325b944, identifier: LA44092
2026-03-28 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-28 11:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-28 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092 to the API
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:53:01Z',
 'fuel_type': 'diesel',
 'id': '7624d114-9828-5d79-866c-1581d325b944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA44092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 156956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI Comfortline Family',
 'transmission': 'automatic',
 'trim': 'Comfortline Family',
 'year': 2003}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Saving data for LA44092: {'auction_closing_time': 1774716781.0, 'created_time': 1774607678.694246, 'last_price_update_time': 1774695658.011039}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA44092') HTTP/1.1" 204 0
2026-03-28 11:00:58 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Scrape type for JL12737: 2
2026-03-28 11:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-28 11:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8cee521-5ad3-55fb-8975-6c4b63651cf6, identifier: JL12737
2026-03-28 11:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-28 11:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-28 11:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737 to the API
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:58:38Z',
 'fuel_type': 'hybrid',
 'id': 'c8cee521-5ad3-55fb-8975-6c4b63651cf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL12737',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 68914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-09',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake Edition 2020 AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Saving data for JL12737: {'auction_closing_time': 1774717118.0, 'created_time': 1774607693.391996, 'last_price_update_time': 1774695658.403533}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL12737') HTTP/1.1" 204 0
2026-03-28 11:00:58 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-28 11:00:58 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Scrape type for AX51342: 2
2026-03-28 11:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-28 11:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05173537-eda3-5b76-9666-74ea991d2f44, identifier: AX51342
2026-03-28 11:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-28 11:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-28 11:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342 to the API
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:59Z',
 'fuel_type': 'petrol',
 'id': '05173537-eda3-5b76-9666-74ea991d2f44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51342',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 130502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Saving data for AX51342: {'auction_closing_time': 1774716419.0, 'created_time': 1774607700.087076, 'last_price_update_time': 1774695658.827831}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX51342') HTTP/1.1" 204 0
2026-03-28 11:00:58 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.de] INFO: Scrape type for HJ55484: 2
2026-03-28 11:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-28 11:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-28 11:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4352be-c350-58e6-a2e7-0dd00772eb46, identifier: HJ55484
2026-03-28 11:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-28 11:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-28 11:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484 to the API
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:53Z',
 'fuel_type': 'diesel',
 'id': '2a4352be-c350-58e6-a2e7-0dd00772eb46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ55484',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 283137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'manual',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [auto1.de] INFO: Saving data for HJ55484: {'auction_closing_time': 1774715993.0, 'created_time': 1774350130.575712, 'last_price_update_time': 1774695659.264479}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ55484') HTTP/1.1" 204 0
2026-03-28 11:00:59 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 11:00:59 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [auto1.de] INFO: Scrape type for MW22662: 2
2026-03-28 11:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-28 11:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 2
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 2
2026-03-28 11:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6cb348-dd04-59cc-8e81-195f4ed65c45, identifier: MW22662
2026-03-28 11:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-28 11:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-28 11:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662 to the API
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:00:25Z',
 'fuel_type': 'diesel',
 'id': 'dc6cb348-dd04-59cc-8e81-195f4ed65c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW22662',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 161813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Ford Transit 1.6 TDCi Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2015}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [auto1.de] INFO: Saving data for MW22662: {'auction_closing_time': 1774713625.0, 'created_time': 1774607673.95788, 'last_price_update_time': 1774695659.790693}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW22662') HTTP/1.1" 204 0
2026-03-28 11:00:59 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [auto1.de] INFO: Scrape type for HB69443: 2
2026-03-28 11:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-28 11:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b25a198-d146-57be-a887-728299e787cb with scrape type 2
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b25a198-d146-57be-a887-728299e787cb with scrape type 2
2026-03-28 11:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b25a198-d146-57be-a887-728299e787cb, identifier: HB69443
2026-03-28 11:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-28 11:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-28 11:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443 to the API
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-28T16:17:56Z',
 'fuel_type': 'petrol',
 'id': '9b25a198-d146-57be-a887-728299e787cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69443',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 124319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.de] INFO: Saving data for HB69443: {'auction_closing_time': 1774714676.0, 'created_time': 1774607665.52394, 'last_price_update_time': 1774695660.228238}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69443') HTTP/1.1" 204 0
2026-03-28 11:01:00 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.de] INFO: Scrape type for MV22283: 2
2026-03-28 11:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-28 11:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e68008-6e09-585a-8a23-6e61472fd2d7 with scrape type 2
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9e68008-6e09-585a-8a23-6e61472fd2d7 with scrape type 2
2026-03-28 11:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9e68008-6e09-585a-8a23-6e61472fd2d7, identifier: MV22283
2026-03-28 11:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-28 11:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-28 11:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283 to the API
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:50Z',
 'fuel_type': 'petrol',
 'id': 'f9e68008-6e09-585a-8a23-6e61472fd2d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV22283',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 119709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.de] INFO: Saving data for MV22283: {'auction_closing_time': 1774715870.0, 'created_time': 1774607674.404054, 'last_price_update_time': 1774695660.627428}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV22283') HTTP/1.1" 204 0
2026-03-28 11:01:00 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 11:01:00 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.de] INFO: Scrape type for WT41205: 2
2026-03-28 11:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-28 11:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7aca7eb-4622-58f1-bd6f-135a79fab690 with scrape type 2
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7aca7eb-4622-58f1-bd6f-135a79fab690 with scrape type 2
2026-03-28 11:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7aca7eb-4622-58f1-bd6f-135a79fab690, identifier: WT41205
2026-03-28 11:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-28 11:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-28 11:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205 to the API
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:32Z',
 'fuel_type': 'petrol',
 'id': 'f7aca7eb-4622-58f1-bd6f-135a79fab690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT41205',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 40096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Smart forfour 0.9 Turbo Basis Prime',
 'transmission': 'manual',
 'trim': 'Basis Prime',
 'year': 2018}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Saving data for WT41205: {'auction_closing_time': 1774714292.0, 'created_time': 1774607672.417099, 'last_price_update_time': 1774695661.013171}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT41205') HTTP/1.1" 204 0
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Scrape type for AU24928: 2
2026-03-28 11:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-28 11:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-28 11:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e13eef-5664-50f8-bdfc-5969f3249f90, identifier: AU24928
2026-03-28 11:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-28 11:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-28 11:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928 to the API
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:36:58Z',
 'fuel_type': 'petrol',
 'id': 'a5e13eef-5664-50f8-bdfc-5969f3249f90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU24928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 132756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Saving data for AU24928: {'auction_closing_time': 1774715818.0, 'created_time': 1773466810.388461, 'last_price_update_time': 1774695661.448922}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU24928') HTTP/1.1" 204 0
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Scrape type for BK59777: 2
2026-03-28 11:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-28 11:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8fe179-f946-56a3-b1cf-18343391a95d with scrape type 2
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca8fe179-f946-56a3-b1cf-18343391a95d with scrape type 2
2026-03-28 11:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca8fe179-f946-56a3-b1cf-18343391a95d, identifier: BK59777
2026-03-28 11:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-28 11:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-28 11:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777 to the API
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:21Z',
 'fuel_type': 'diesel',
 'id': 'ca8fe179-f946-56a3-b1cf-18343391a95d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK59777',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 169653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Saving data for BK59777: {'auction_closing_time': 1774715721.0, 'created_time': 1774607666.584721, 'last_price_update_time': 1774695661.954996}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK59777') HTTP/1.1" 204 0
2026-03-28 11:01:01 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.de] INFO: Scrape type for FB09525: 2
2026-03-28 11:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-28 11:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 2
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 2
2026-03-28 11:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4875374d-89bd-5a6f-bca6-da0fbda33735, identifier: FB09525
2026-03-28 11:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-28 11:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-28 11:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525 to the API
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:16:37Z',
 'fuel_type': 'diesel',
 'id': '4875374d-89bd-5a6f-bca6-da0fbda33735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB09525',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 157208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.de] INFO: Saving data for FB09525: {'auction_closing_time': 1774714597.0, 'created_time': 1774607778.314263, 'last_price_update_time': 1774695662.361083}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB09525') HTTP/1.1" 204 0
2026-03-28 11:01:02 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.de] INFO: Scrape type for NL50541: 2
2026-03-28 11:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-28 11:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b989f977-03f8-524b-b789-c6c3e12d3a40 with scrape type 2
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b989f977-03f8-524b-b789-c6c3e12d3a40 with scrape type 2
2026-03-28 11:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b989f977-03f8-524b-b789-c6c3e12d3a40, identifier: NL50541
2026-03-28 11:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-28 11:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-28 11:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541 to the API
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:37:39Z',
 'fuel_type': 'petrol',
 'id': 'b989f977-03f8-524b-b789-c6c3e12d3a40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL50541',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 82885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.de] INFO: Saving data for NL50541: {'auction_closing_time': 1774715859.0, 'created_time': 1774607670.340112, 'last_price_update_time': 1774695662.773562}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL50541') HTTP/1.1" 204 0
2026-03-28 11:01:02 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.de] INFO: Scrape type for AB87355: 2
2026-03-28 11:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-28 11:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-28 11:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c, identifier: AB87355
2026-03-28 11:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-28 11:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-28 11:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355 to the API
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:03Z',
 'fuel_type': 'diesel',
 'id': '682cc8fc-7570-5a7c-80e9-f8a66b55e40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB87355',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 135653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.7 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2020}
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.de] INFO: Saving data for AB87355: {'auction_closing_time': 1774716543.0, 'created_time': 1773135611.397026, 'last_price_update_time': 1774695663.231293}
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB87355') HTTP/1.1" 204 0
2026-03-28 11:01:03 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 11:01:03 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.de] INFO: Scrape type for NX68666: 2
2026-03-28 11:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-28 11:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-28 11:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0edef07e-dd48-59ca-bd0d-b906c2156b4e, identifier: NX68666
2026-03-28 11:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-28 11:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-28 11:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666 to the API
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:55Z',
 'fuel_type': 'diesel',
 'id': '0edef07e-dd48-59ca-bd0d-b906c2156b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68666',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 257580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.de] INFO: Saving data for NX68666: {'auction_closing_time': 1774716115.0, 'created_time': 1773306693.534233, 'last_price_update_time': 1774695663.660041}
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68666') HTTP/1.1" 204 0
2026-03-28 11:01:03 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.de] INFO: Scrape type for JT97344: 2
2026-03-28 11:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-28 11:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 2
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 2
2026-03-28 11:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16, identifier: JT97344
2026-03-28 11:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-28 11:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-28 11:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344 to the API
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:31Z',
 'fuel_type': 'petrol',
 'id': '5e7cdcb4-4aba-585c-98fe-7da47fcbfc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT97344',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 125822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-02',
 'seller_name': None,
 'title': 'BMW 2er 218i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2015}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-28 11:01:04 [auto1.de] INFO: Saving data for JT97344: {'auction_closing_time': 1774716991.0, 'created_time': 1774607725.328708, 'last_price_update_time': 1774695664.064177}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT97344') HTTP/1.1" 204 0
2026-03-28 11:01:04 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 11:01:04 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 11:01:04 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 11:01:04 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 11:01:04 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 11:01:04 [auto1.de] INFO: Scrape type for GE37655: 2
2026-03-28 11:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-28 11:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 2
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 2
2026-03-28 11:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badceaec-0e01-5c5e-9127-6ea619c9275e, identifier: GE37655
2026-03-28 11:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-28 11:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-28 11:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655 to the API
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:36:16Z',
 'fuel_type': 'petrol',
 'id': 'badceaec-0e01-5c5e-9127-6ea619c9275e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE37655',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex 4x4',
 'year': 2014}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 11:01:04 [auto1.de] INFO: Saving data for GE37655: {'auction_closing_time': 1774715776.0, 'created_time': 1774607708.263554, 'last_price_update_time': 1774695664.480828}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE37655') HTTP/1.1" 204 0
2026-03-28 11:01:06 [scrapy.extensions.logstats] INFO: Crawled 407 pages (at 4 pages/min), scraped 326 items (at 101 items/min)
2026-03-28 11:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:32 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9695 | hits on page: 40
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [auto1.de] INFO: Scrape type for FF90181: 2
2026-03-28 11:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-28 11:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-28 11:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca34f071-0187-52ec-8a15-c95d1d1c51b1, identifier: FF90181
2026-03-28 11:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-28 11:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-28 11:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181 to the API
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:15:28Z',
 'fuel_type': 'hybrid',
 'id': 'ca34f071-0187-52ec-8a15-c95d1d1c51b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF90181',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 33611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2021}
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [auto1.de] INFO: Saving data for FF90181: {'auction_closing_time': 1774714528.0, 'created_time': 1773344622.488958, 'last_price_update_time': 1774695692.772931}
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF90181') HTTP/1.1" 204 0
2026-03-28 11:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-28 11:01:32 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [auto1.de] INFO: Scrape type for RS38976: 2
2026-03-28 11:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-28 11:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1b26a6-bed1-5b57-8c06-508028f76179 with scrape type 2
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e1b26a6-bed1-5b57-8c06-508028f76179 with scrape type 2
2026-03-28 11:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e1b26a6-bed1-5b57-8c06-508028f76179, identifier: RS38976
2026-03-28 11:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-28 11:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-28 11:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976 to the API
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:59Z',
 'fuel_type': 'petrol',
 'id': '7e1b26a6-bed1-5b57-8c06-508028f76179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS38976',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 128592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2005}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.de] INFO: Saving data for RS38976: {'auction_closing_time': 1774714019.0, 'created_time': 1774607692.720533, 'last_price_update_time': 1774695693.205793}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS38976') HTTP/1.1" 204 0
2026-03-28 11:01:33 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 11:01:33 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 11:01:33 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 11:01:33 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.de] INFO: Scrape type for ZU85888: 2
2026-03-28 11:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-28 11:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with scrape type 2
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with scrape type 2
2026-03-28 11:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f1b08f-2561-5fb0-886a-0e49d3d43b97, identifier: ZU85888
2026-03-28 11:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-28 11:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-28 11:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888 to the API
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:06:05Z',
 'fuel_type': 'petrol',
 'id': 'd0f1b08f-2561-5fb0-886a-0e49d3d43b97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU85888',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 101609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.de] INFO: Saving data for ZU85888: {'auction_closing_time': 1774713965.0, 'created_time': 1774607703.654761, 'last_price_update_time': 1774695693.648283}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU85888') HTTP/1.1" 204 0
2026-03-28 11:01:33 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.de] INFO: Scrape type for VW35628: 2
2026-03-28 11:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-28 11:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abe673c-8b77-541a-9295-cefbdf803274 with scrape type 2
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abe673c-8b77-541a-9295-cefbdf803274 with scrape type 2
2026-03-28 11:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abe673c-8b77-541a-9295-cefbdf803274, identifier: VW35628
2026-03-28 11:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-28 11:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-28 11:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628 to the API
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'petrol',
 'id': '0abe673c-8b77-541a-9295-cefbdf803274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW35628',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 166657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-02',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact',
 'transmission': 'manual',
 'trim': 'Compact',
 'year': 2003}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.de] INFO: Saving data for VW35628: {'auction_closing_time': 1774713779.0, 'created_time': 1774607695.469255, 'last_price_update_time': 1774695694.186385}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW35628') HTTP/1.1" 204 0
2026-03-28 11:01:34 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-28 11:01:34 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 11:01:34 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.de] INFO: Scrape type for BN48826: 2
2026-03-28 11:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-28 11:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 2
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 2
2026-03-28 11:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2072bb-abe0-5396-9d15-155b7e92c1c6, identifier: BN48826
2026-03-28 11:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-28 11:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-28 11:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826 to the API
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:32:10Z',
 'fuel_type': 'diesel',
 'id': '3d2072bb-abe0-5396-9d15-155b7e92c1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN48826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 333254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-21',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2009}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.de] INFO: Saving data for BN48826: {'auction_closing_time': 1774715530.0, 'created_time': 1774607724.093854, 'last_price_update_time': 1774695694.670609}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN48826') HTTP/1.1" 204 0
2026-03-28 11:01:34 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.de] INFO: Scrape type for LR18629: 2
2026-03-28 11:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-28 11:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with scrape type 2
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with scrape type 2
2026-03-28 11:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6, identifier: LR18629
2026-03-28 11:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-28 11:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-28 11:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629 to the API
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:25:49Z',
 'fuel_type': 'petrol',
 'id': '83334a2b-1f01-51c3-aadc-43ee3bbe70e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR18629',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 196305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-22',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Ambiente 4x4',
 'transmission': 'manual',
 'trim': 'Ambiente 4x4',
 'year': 2011}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Saving data for LR18629: {'auction_closing_time': 1774715149.0, 'created_time': 1774607726.496714, 'last_price_update_time': 1774695695.100151}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR18629') HTTP/1.1" 204 0
2026-03-28 11:01:35 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-28 11:01:35 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Scrape type for BB33034: 2
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b641efa-2fe5-5e81-b564-e66e5de30046, identifier: BB33034
2026-03-28 11:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-28 11:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-28 11:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034 to the API
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:17Z',
 'fuel_type': 'diesel',
 'id': '1b641efa-2fe5-5e81-b564-e66e5de30046',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB33034',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 171576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-12-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 1998}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Saving data for BB33034: {'auction_closing_time': 1774717097.0, 'created_time': 1774607724.567191, 'last_price_update_time': 1774695695.522241}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB33034') HTTP/1.1" 204 0
2026-03-28 11:01:35 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Scrape type for ZW26780: 2
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3285384a-2312-5ad7-a02e-5f2753b85caf, identifier: ZW26780
2026-03-28 11:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-28 11:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-28 11:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780 to the API
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:51Z',
 'fuel_type': 'diesel',
 'id': '3285384a-2312-5ad7-a02e-5f2753b85caf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW26780',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 466645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Saving data for ZW26780: {'auction_closing_time': 1774713771.0, 'created_time': 1774607722.436272, 'last_price_update_time': 1774695695.922103}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW26780') HTTP/1.1" 204 0
2026-03-28 11:01:35 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 11:01:35 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [auto1.de] INFO: Scrape type for PA36365: 2
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 975e6ac5-250d-5bb6-8ecf-3308799273a7, identifier: PA36365
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-28 11:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365 to the API
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:26:42Z',
 'fuel_type': 'electro',
 'id': '975e6ac5-250d-5bb6-8ecf-3308799273a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA36365',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 9,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [auto1.de] INFO: Saving data for PA36365: {'auction_closing_time': 1774715202.0, 'created_time': 1774607711.25831, 'last_price_update_time': 1774695696.58129}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA36365') HTTP/1.1" 204 0
2026-03-28 11:01:36 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 11:01:36 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [auto1.de] INFO: Scrape type for KC35382: 2
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb615a1b-1996-5280-a7b5-0122438e64ae, identifier: KC35382
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-28 11:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382 to the API
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:51Z',
 'fuel_type': 'diesel',
 'id': 'cb615a1b-1996-5280-a7b5-0122438e64ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC35382',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 202577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [auto1.de] INFO: Saving data for KC35382: {'auction_closing_time': 1774717011.0, 'created_time': 1774607711.85655, 'last_price_update_time': 1774695696.983326}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC35382') HTTP/1.1" 204 0
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.de] INFO: Scrape type for EX72807: 2
2026-03-28 11:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-28 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43318222-ef16-5cd0-a232-fd188c04160c, identifier: EX72807
2026-03-28 11:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-28 11:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807 to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:41Z',
 'fuel_type': 'diesel',
 'id': '43318222-ef16-5cd0-a232-fd188c04160c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX72807',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 130569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.de] INFO: Saving data for EX72807: {'auction_closing_time': 1774716041.0, 'created_time': 1773469046.034686, 'last_price_update_time': 1774695697.533569}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX72807') HTTP/1.1" 204 0
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.de] INFO: Scrape type for EG01443: 2
2026-03-28 11:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-28 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b19c138f-460c-535d-869f-4eec7e1c6d68, identifier: EG01443
2026-03-28 11:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-28 11:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443 to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:39Z',
 'fuel_type': 'diesel',
 'id': 'b19c138f-460c-535d-869f-4eec7e1c6d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG01443',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 216114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-08',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.de] INFO: Saving data for EG01443: {'auction_closing_time': 1774714719.0, 'created_time': 1774349808.324643, 'last_price_update_time': 1774695697.962771}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG01443') HTTP/1.1" 204 0
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 11:01:37 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.de] INFO: Scrape type for KL31894: 2
2026-03-28 11:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-28 11:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7, identifier: KL31894
2026-03-28 11:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-28 11:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-28 11:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894 to the API
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:40Z',
 'fuel_type': 'diesel',
 'id': '17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL31894',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 208008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.de] INFO: Saving data for KL31894: {'auction_closing_time': 1774714660.0, 'created_time': 1773945787.355259, 'last_price_update_time': 1774695698.452106}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL31894') HTTP/1.1" 204 0
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 11:01:38 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.de] INFO: Scrape type for VD47640: 2
2026-03-28 11:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-28 11:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54967f61-1aaa-5902-8603-1d7d74a7eb13 with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54967f61-1aaa-5902-8603-1d7d74a7eb13 with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54967f61-1aaa-5902-8603-1d7d74a7eb13, identifier: VD47640
2026-03-28 11:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-28 11:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-28 11:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640 to the API
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:56:00Z',
 'fuel_type': 'petrol',
 'id': '54967f61-1aaa-5902-8603-1d7d74a7eb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD47640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 282939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-24',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.de] INFO: Saving data for VD47640: {'auction_closing_time': 1774716960.0, 'created_time': 1774607731.474976, 'last_price_update_time': 1774695698.894415}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD47640') HTTP/1.1" 204 0
2026-03-28 11:01:39 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.de] INFO: Scrape type for DU13341: 2
2026-03-28 11:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-28 11:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024715b1-48ce-5f67-9e2a-0cc581d891d5 with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 024715b1-48ce-5f67-9e2a-0cc581d891d5 with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 024715b1-48ce-5f67-9e2a-0cc581d891d5, identifier: DU13341
2026-03-28 11:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-28 11:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-28 11:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341 to the API
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:49Z',
 'fuel_type': 'diesel',
 'id': '024715b1-48ce-5f67-9e2a-0cc581d891d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13341',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 89534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-20',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.de] INFO: Saving data for DU13341: {'auction_closing_time': 1774715869.0, 'created_time': 1774607734.573263, 'last_price_update_time': 1774695699.473412}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13341') HTTP/1.1" 204 0
2026-03-28 11:01:39 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.de] INFO: Scrape type for WC36574: 2
2026-03-28 11:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-28 11:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a59a4e2-eaee-5bde-997a-74185c967ddd, identifier: WC36574
2026-03-28 11:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-28 11:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-28 11:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574 to the API
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:00:47Z',
 'fuel_type': 'diesel',
 'id': '3a59a4e2-eaee-5bde-997a-74185c967ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC36574',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 148460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.de] INFO: Saving data for WC36574: {'auction_closing_time': 1774713647.0, 'created_time': 1773225333.642473, 'last_price_update_time': 1774695699.942518}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC36574') HTTP/1.1" 204 0
2026-03-28 11:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:40 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:40 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-28 11:01:40 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-28 11:01:40 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Scrape type for XB85584: 2
2026-03-28 11:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-28 11:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ef623d-3a90-541b-8018-5c676ee4d2ce, identifier: XB85584
2026-03-28 11:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-28 11:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-28 11:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584 to the API
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:38:12Z',
 'fuel_type': 'petrol',
 'id': '60ef623d-3a90-541b-8018-5c676ee4d2ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB85584',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 201312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-22',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Saving data for XB85584: {'auction_closing_time': 1774715892.0, 'created_time': 1774607822.817247, 'last_price_update_time': 1774695700.525251}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB85584') HTTP/1.1" 204 0
2026-03-28 11:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:40 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Scrape type for HB67521: 2
2026-03-28 11:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-28 11:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1320fc40-bba8-5bfd-9d6c-41e790b295bd, identifier: HB67521
2026-03-28 11:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-28 11:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-28 11:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521 to the API
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:00:48Z',
 'fuel_type': 'diesel',
 'id': '1320fc40-bba8-5bfd-9d6c-41e790b295bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB67521',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 459875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Saving data for HB67521: {'auction_closing_time': 1774713648.0, 'created_time': 1774607854.208083, 'last_price_update_time': 1774695700.932605}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB67521') HTTP/1.1" 204 0
2026-03-28 11:01:40 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.de] INFO: Scrape type for SE52893: 2
2026-03-28 11:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-28 11:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fb4b2bf-cac9-5128-a161-31ade47b4930, identifier: SE52893
2026-03-28 11:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-28 11:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-28 11:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893 to the API
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:10Z',
 'fuel_type': 'petrol',
 'id': '3fb4b2bf-cac9-5128-a161-31ade47b4930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE52893',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 152075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-20',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2020}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.de] INFO: Saving data for SE52893: {'auction_closing_time': 1774714510.0, 'created_time': 1774607769.152934, 'last_price_update_time': 1774695701.40288}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE52893') HTTP/1.1" 204 0
2026-03-28 11:01:41 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 11:01:41 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-28 11:01:41 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.de] INFO: Scrape type for SD86365: 2
2026-03-28 11:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-28 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f, identifier: SD86365
2026-03-28 11:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-28 11:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-28 11:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365 to the API
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:51Z',
 'fuel_type': 'petrol',
 'id': '823f3697-7e54-5ca7-8bc2-9b9aef41ab8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86365',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 22707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2023}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.de] INFO: Saving data for SD86365: {'auction_closing_time': 1774716291.0, 'created_time': 1774607840.816728, 'last_price_update_time': 1774695701.811038}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD86365') HTTP/1.1" 204 0
2026-03-28 11:01:41 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 11:01:41 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.de] INFO: Scrape type for LF03511: 2
2026-03-28 11:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-28 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a758a659-716e-5297-8a6b-9aeaccb932cf, identifier: LF03511
2026-03-28 11:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-28 11:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-28 11:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511 to the API
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:17:38Z',
 'fuel_type': 'diesel',
 'id': 'a758a659-716e-5297-8a6b-9aeaccb932cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF03511',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 383480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.de] INFO: Saving data for LF03511: {'auction_closing_time': 1774714658.0, 'created_time': 1774607759.881561, 'last_price_update_time': 1774695702.274647}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF03511') HTTP/1.1" 204 0
2026-03-28 11:01:42 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-28 11:01:42 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-28 11:01:42 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 11:01:42 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.de] INFO: Scrape type for PN22226: 2
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4533af-3406-5918-a6b3-59ccde7f674c, identifier: PN22226
2026-03-28 11:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-28 11:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-28 11:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226 to the API
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': '2d4533af-3406-5918-a6b3-59ccde7f674c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN22226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 180303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-04',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TFSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2006}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.de] INFO: Saving data for PN22226: {'auction_closing_time': 1774716057.0, 'created_time': 1774349879.172949, 'last_price_update_time': 1774695702.827821}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN22226') HTTP/1.1" 204 0
2026-03-28 11:01:42 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.de] INFO: Scrape type for AG44420: 2
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0730e37a-33a2-5940-a0cc-76627c551249 with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0730e37a-33a2-5940-a0cc-76627c551249 with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0730e37a-33a2-5940-a0cc-76627c551249, identifier: AG44420
2026-03-28 11:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-28 11:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-28 11:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420 to the API
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:57:09Z',
 'fuel_type': 'diesel',
 'id': '0730e37a-33a2-5940-a0cc-76627c551249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44420',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 81911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM Work Up Pritsche',
 'transmission': 'manual',
 'trim': 'Work Up Pritsche',
 'year': 2019}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.de] INFO: Saving data for AG44420: {'auction_closing_time': 1774717029.0, 'created_time': 1774607825.665276, 'last_price_update_time': 1774695703.254468}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44420') HTTP/1.1" 204 0
2026-03-28 11:01:43 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.de] INFO: Scrape type for MJ13308: 2
2026-03-28 11:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-28 11:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 008cc6e2-55c5-5480-8821-9f7a501d47fe, identifier: MJ13308
2026-03-28 11:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-28 11:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-28 11:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308 to the API
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:07:07Z',
 'fuel_type': 'diesel',
 'id': '008cc6e2-55c5-5480-8821-9f7a501d47fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ13308',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 206699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2015}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.de] INFO: Saving data for MJ13308: {'auction_closing_time': 1774714027.0, 'created_time': 1774607763.846868, 'last_price_update_time': 1774695703.681305}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ13308') HTTP/1.1" 204 0
2026-03-28 11:01:43 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.de] INFO: Scrape type for WC63339: 2
2026-03-28 11:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-28 11:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d797935d-6332-5bd1-b9eb-fdcde16c6582, identifier: WC63339
2026-03-28 11:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-28 11:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-28 11:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339 to the API
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:26:09Z',
 'fuel_type': 'petrol',
 'id': 'd797935d-6332-5bd1-b9eb-fdcde16c6582',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63339',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'BMW 3er 318i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Saving data for WC63339: {'auction_closing_time': 1774715169.0, 'created_time': 1774607795.166984, 'last_price_update_time': 1774695704.09858}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC63339') HTTP/1.1" 204 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for LL66179: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5, identifier: LL66179
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179 to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'diesel',
 'id': 'cdbc69b1-0d6f-5425-9245-fc5fd47d23b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL66179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 248756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Saving data for LL66179: {'auction_closing_time': 1774714642.0, 'created_time': 1774607813.682539, 'last_price_update_time': 1774695704.514753}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL66179') HTTP/1.1" 204 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for VP53971: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4, identifier: VP53971
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971 to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:25:00Z',
 'fuel_type': 'petrol',
 'id': '510f7c3b-f861-5e6a-8d56-af1e5fde3ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP53971',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 168031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2018}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Saving data for VP53971: {'auction_closing_time': 1774715100.0, 'created_time': 1774607761.313211, 'last_price_update_time': 1774695704.940177}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP53971') HTTP/1.1" 204 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for DE09566: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46f2104-2545-581e-b8f2-ebd402e80dbd, identifier: DE09566
2026-03-28 11:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-28 11:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-28 11:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566 to the API
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:02:32Z',
 'fuel_type': 'diesel',
 'id': 'c46f2104-2545-581e-b8f2-ebd402e80dbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE09566',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 76671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2021}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Saving data for DE09566: {'auction_closing_time': 1774713752.0, 'created_time': 1773830261.466794, 'last_price_update_time': 1774695705.390862}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE09566') HTTP/1.1" 204 0
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Scrape type for NR35268: 2
2026-03-28 11:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-28 11:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbde5c8b-caec-5be7-b8fc-33d8767b0773, identifier: NR35268
2026-03-28 11:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-28 11:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-28 11:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268 to the API
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:25Z',
 'fuel_type': 'diesel',
 'id': 'fbde5c8b-caec-5be7-b8fc-33d8767b0773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR35268',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 197345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Saving data for NR35268: {'auction_closing_time': 1774716685.0, 'created_time': 1774607746.049985, 'last_price_update_time': 1774695705.806007}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35268') HTTP/1.1" 204 0
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Scrape type for VE41412: 2
2026-03-28 11:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-28 11:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d825d06b-b474-5bb7-b5ab-33cee45e9e0a, identifier: VE41412
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-28 11:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-28 11:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412 to the API
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:04:56Z',
 'fuel_type': 'petrol',
 'id': 'd825d06b-b474-5bb7-b5ab-33cee45e9e0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE41412',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 133740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 TomTom Edition',
 'transmission': 'manual',
 'trim': 'TomTom Edition',
 'year': 2011}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Saving data for VE41412: {'auction_closing_time': 1774713896.0, 'created_time': 1774607791.994961, 'last_price_update_time': 1774695706.409379}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE41412') HTTP/1.1" 204 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for BX01003: 2
2026-03-28 11:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-28 11:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a, identifier: BX01003
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-28 11:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-28 11:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003 to the API
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:48Z',
 'fuel_type': 'petrol',
 'id': '98c38b85-ceba-5d4b-956a-6b2d4cb9925a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX01003',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 55721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2023}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Saving data for BX01003: {'auction_closing_time': 1774713948.0, 'created_time': 1774033517.222013, 'last_price_update_time': 1774695706.855668}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX01003') HTTP/1.1" 204 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for HK20534: 2
2026-03-28 11:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-28 11:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c9de2b-0765-5940-928a-adab1f8b7fb2, identifier: HK20534
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-28 11:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-28 11:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534 to the API
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:26:59Z',
 'fuel_type': 'diesel',
 'id': '15c9de2b-0765-5940-928a-adab1f8b7fb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK20534',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 328635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic BlueTEC Avantgarde',
 'year': 2014}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.de] INFO: Saving data for HK20534: {'auction_closing_time': 1774715219.0, 'created_time': 1774607747.831296, 'last_price_update_time': 1774695707.277292}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK20534') HTTP/1.1" 204 0
2026-03-28 11:01:47 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.de] INFO: Scrape type for UF20593: 2
2026-03-28 11:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-28 11:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0, identifier: UF20593
2026-03-28 11:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-28 11:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-28 11:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593 to the API
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:23Z',
 'fuel_type': 'diesel',
 'id': '747d5343-6e46-554a-bfe8-ba2ab88bd2d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF20593',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 199764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.de] INFO: Saving data for UF20593: {'auction_closing_time': 1774713863.0, 'created_time': 1774607793.549442, 'last_price_update_time': 1774695707.732322}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF20593') HTTP/1.1" 204 0
2026-03-28 11:01:47 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.de] INFO: Scrape type for CC81369: 2
2026-03-28 11:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-28 11:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade8a767-c193-5a42-8ddd-a038d1536bd4, identifier: CC81369
2026-03-28 11:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-28 11:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-28 11:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369 to the API
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:39:53Z',
 'fuel_type': 'diesel',
 'id': 'ade8a767-c193-5a42-8ddd-a038d1536bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC81369',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 135660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
 'transmission': 'manual',
 'trim': '340 L1 Trail',
 'year': 2022}
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.de] INFO: Saving data for CC81369: {'auction_closing_time': 1774715993.0, 'created_time': 1773427441.741455, 'last_price_update_time': 1774695708.180604}
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC81369') HTTP/1.1" 204 0
2026-03-28 11:01:48 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.de] INFO: Scrape type for UN23019: 2
2026-03-28 11:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-28 11:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with scrape type 2
2026-03-28 11:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with scrape type 2
2026-03-28 11:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32, identifier: UN23019
2026-03-28 11:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-28 11:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-28 11:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019 to the API
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:51:45Z',
 'fuel_type': 'diesel',
 'id': 'b3c20ecd-2036-53bb-aae1-3f76fc3d8d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN23019',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 194498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [auto1.de] INFO: Saving data for UN23019: {'auction_closing_time': 1774716705.0, 'created_time': 1774607876.616746, 'last_price_update_time': 1774695709.448867}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN23019') HTTP/1.1" 204 0
2026-03-28 11:01:49 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [auto1.de] INFO: Scrape type for EK21596: 2
2026-03-28 11:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-28 11:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 2
2026-03-28 11:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 2
2026-03-28 11:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, identifier: EK21596
2026-03-28 11:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-28 11:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-28 11:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596 to the API
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:00:35Z',
 'fuel_type': 'petrol',
 'id': '6b02dc6b-cad8-5579-8b4c-ba44ecac7f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK21596',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 6650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 SKYACTIV-G Mild-Hybrid Homura 2WD',
 'transmission': 'manual',
 'trim': 'Homura 2WD',
 'year': 2022}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [auto1.de] INFO: Saving data for EK21596: {'auction_closing_time': 1774713635.0, 'created_time': 1774607857.509515, 'last_price_update_time': 1774695709.902508}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK21596') HTTP/1.1" 204 0
2026-03-28 11:01:50 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-28 11:01:50 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [auto1.de] INFO: Scrape type for SD28198: 2
2026-03-28 11:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-28 11:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c, identifier: SD28198
2026-03-28 11:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-28 11:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-28 11:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198 to the API
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'petrol',
 'id': '84fe5ade-85e6-5fcb-a92a-02bebc918c4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD28198',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 58422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [auto1.de] INFO: Saving data for SD28198: {'auction_closing_time': 1774714267.0, 'created_time': 1774349177.001502, 'last_price_update_time': 1774695710.56188}
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD28198') HTTP/1.1" 204 0
2026-03-28 11:01:50 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 11:01:50 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [auto1.de] INFO: Scrape type for NG44703: 2
2026-03-28 11:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-28 11:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4a405ad-9c93-5878-9f15-78035a93bfa7, identifier: NG44703
2026-03-28 11:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-28 11:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-28 11:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703 to the API
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:18Z',
 'fuel_type': 'petrol',
 'id': 'b4a405ad-9c93-5878-9f15-78035a93bfa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG44703',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 143570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2007}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [auto1.de] INFO: Saving data for NG44703: {'auction_closing_time': 1774715358.0, 'created_time': 1774607874.812894, 'last_price_update_time': 1774695711.041527}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG44703') HTTP/1.1" 204 0
2026-03-28 11:01:51 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:51 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-28 11:01:51 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 11:01:51 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [auto1.de] INFO: Scrape type for HP18010: 2
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace3c96b-073d-5738-ba17-0aac289b23c1, identifier: HP18010
2026-03-28 11:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-28 11:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-28 11:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010 to the API
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:56:25Z',
 'fuel_type': 'petrol',
 'id': 'ace3c96b-073d-5738-ba17-0aac289b23c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP18010',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 131920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [auto1.de] INFO: Saving data for HP18010: {'auction_closing_time': 1774716985.0, 'created_time': 1773946331.362141, 'last_price_update_time': 1774695711.663985}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP18010') HTTP/1.1" 204 0
2026-03-28 11:01:51 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 11:01:51 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [auto1.de] INFO: Scrape type for VC15219: 2
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176b6796-b315-5892-8a1f-c59c040a9398 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 176b6796-b315-5892-8a1f-c59c040a9398 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 176b6796-b315-5892-8a1f-c59c040a9398, identifier: VC15219
2026-03-28 11:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-28 11:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-28 11:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219 to the API
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:11:01Z',
 'fuel_type': 'petrol',
 'id': '176b6796-b315-5892-8a1f-c59c040a9398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC15219',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 204619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Saving data for VC15219: {'auction_closing_time': 1774714261.0, 'created_time': 1774607768.588551, 'last_price_update_time': 1774695712.173987}
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC15219') HTTP/1.1" 204 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for GA58010: 2
2026-03-28 11:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-28 11:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3407ec16-f216-53cf-8596-04c9d08efdab, identifier: GA58010
2026-03-28 11:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-28 11:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-28 11:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010 to the API
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:05:03Z',
 'fuel_type': 'petrol',
 'id': '3407ec16-f216-53cf-8596-04c9d08efdab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA58010',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 87839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2023}
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Saving data for GA58010: {'auction_closing_time': 1774713903.0, 'created_time': 1774032456.724292, 'last_price_update_time': 1774695712.749379}
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA58010') HTTP/1.1" 204 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for DF59303: 2
2026-03-28 11:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-28 11:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dec8777f-db22-5074-8234-bea71fe8a5c3, identifier: DF59303
2026-03-28 11:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-28 11:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-28 11:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303 to the API
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:30Z',
 'fuel_type': 'petrol',
 'id': 'dec8777f-db22-5074-8234-bea71fe8a5c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF59303',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 19573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Saving data for DF59303: {'auction_closing_time': 1774715610.0, 'created_time': 1774349141.749505, 'last_price_update_time': 1774695713.308311}
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF59303') HTTP/1.1" 204 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for TU49821: 2
2026-03-28 11:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-28 11:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 2
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 2
2026-03-28 11:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c1b93f-5b90-55e1-a318-40937b4c67bc, identifier: TU49821
2026-03-28 11:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-28 11:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-28 11:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821 to the API
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:59:16Z',
 'fuel_type': 'petrol',
 'id': 'd4c1b93f-5b90-55e1-a318-40937b4c67bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU49821',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 81645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Basis 2WD',
 'transmission': 'manual',
 'trim': 'Basis 2WD',
 'year': 2018}
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-28 11:01:54 [auto1.de] INFO: Saving data for TU49821: {'auction_closing_time': 1774717156.0, 'created_time': 1774607850.033683, 'last_price_update_time': 1774695714.394766}
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU49821') HTTP/1.1" 204 0
2026-03-28 11:01:54 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-28 11:01:54 [auto1.de] INFO: Scrape type for CG74532: 2
2026-03-28 11:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-28 11:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-28 11:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a58d5979-6367-5f36-826c-2bb8c4b2a739, identifier: CG74532
2026-03-28 11:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-28 11:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-28 11:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532 to the API
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:44:52Z',
 'fuel_type': 'diesel',
 'id': 'a58d5979-6367-5f36-826c-2bb8c4b2a739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG74532',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 125978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-28 11:01:54 [auto1.de] INFO: Saving data for CG74532: {'auction_closing_time': 1774716292.0, 'created_time': 1773308375.619079, 'last_price_update_time': 1774695714.839085}
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG74532') HTTP/1.1" 204 0
2026-03-28 11:01:54 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-28 11:01:54 [auto1.de] INFO: Scrape type for DF30572: 2
2026-03-28 11:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-28 11:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd48c03-6923-57f2-a307-4afd38fb7625 with scrape type 2
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd48c03-6923-57f2-a307-4afd38fb7625 with scrape type 2
2026-03-28 11:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dd48c03-6923-57f2-a307-4afd38fb7625, identifier: DF30572
2026-03-28 11:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-28 11:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-28 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572 to the API
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:02Z',
 'fuel_type': 'petrol',
 'id': '7dd48c03-6923-57f2-a307-4afd38fb7625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF30572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 79824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2016}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-28 11:01:55 [auto1.de] INFO: Saving data for DF30572: {'auction_closing_time': 1774716482.0, 'created_time': 1774607819.527943, 'last_price_update_time': 1774695715.258886}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF30572') HTTP/1.1" 204 0
2026-03-28 11:01:55 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-28 11:01:55 [auto1.de] INFO: Scrape type for CK07133: 2
2026-03-28 11:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-28 11:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2983a78-277c-5fd4-a391-68b07ebff38e with scrape type 2
2026-03-28 11:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2983a78-277c-5fd4-a391-68b07ebff38e with scrape type 2
2026-03-28 11:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2983a78-277c-5fd4-a391-68b07ebff38e, identifier: CK07133
2026-03-28 11:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-28 11:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-28 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133 to the API
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:12Z',
 'fuel_type': 'petrol',
 'id': 'c2983a78-277c-5fd4-a391-68b07ebff38e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK07133',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 121435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Turbo S-Design',
 'transmission': 'manual',
 'trim': 'S-Design',
 'year': 2019}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-28 11:01:55 [auto1.de] INFO: Saving data for CK07133: {'auction_closing_time': 1774715832.0, 'created_time': 1774607865.653676, 'last_price_update_time': 1774695715.687325}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK07133') HTTP/1.1" 204 0
2026-03-28 11:01:55 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-28 11:01:55 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-28 11:01:55 [auto1.de] INFO: Scrape type for XH18940: 2
2026-03-28 11:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-28 11:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 2
2026-03-28 11:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 2
2026-03-28 11:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad, identifier: XH18940
2026-03-28 11:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-28 11:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-28 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940 to the API
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:14:12Z',
 'fuel_type': 'petrol',
 'id': '2cfc60ef-fade-5bc4-ba8e-b40f682e77ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH18940',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Suburban',
 'odometer': 184711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-31',
 'seller_name': None,
 'title': 'Chevrolet Suburban 5.7 V8 LS 4WD',
 'transmission': 'automatic',
 'trim': 'LS 4WD',
 'year': 2018}
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-28 11:01:56 [auto1.de] INFO: Saving data for XH18940: {'auction_closing_time': 1774714452.0, 'created_time': 1774607744.457554, 'last_price_update_time': 1774695716.401127}
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH18940') HTTP/1.1" 204 0
2026-03-28 11:01:56 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 11:01:56 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 11:01:56 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-28 11:01:56 [auto1.de] INFO: Scrape type for BE25239: 2
2026-03-28 11:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-28 11:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-28 11:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1e4a606-ed58-50e2-98b1-5cd386f24c2e, identifier: BE25239
2026-03-28 11:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:01:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-28 11:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239 to the API
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:57Z',
 'fuel_type': 'gas',
 'id': 'a1e4a606-ed58-50e2-98b1-5cd386f24c2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE25239',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 158666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-02',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 Kasten EcoFuel',
 'transmission': 'manual',
 'trim': 'Kasten EcoFuel',
 'year': 2009}
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-28 11:01:57 [auto1.de] INFO: Saving data for BE25239: {'auction_closing_time': 1774716597.0, 'created_time': 1774349139.776538, 'last_price_update_time': 1774695717.116331}
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE25239') HTTP/1.1" 204 0
2026-03-28 11:01:57 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-28 11:01:57 [auto1.de] INFO: Scrape type for JN21638: 2
2026-03-28 11:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-28 11:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 2
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 2
2026-03-28 11:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5919942e-8741-5202-9d95-746fcf93fc13, identifier: JN21638
2026-03-28 11:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-28 11:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-28 11:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638 to the API
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:45:36Z',
 'fuel_type': 'petrol',
 'id': '5919942e-8741-5202-9d95-746fcf93fc13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN21638',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 101794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-28 11:01:57 [auto1.de] INFO: Saving data for JN21638: {'auction_closing_time': 1774716336.0, 'created_time': 1774607780.93747, 'last_price_update_time': 1774695717.7288}
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN21638') HTTP/1.1" 204 0
2026-03-28 11:01:57 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 11:01:57 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-28 11:01:57 [auto1.de] INFO: Scrape type for HL08327: 2
2026-03-28 11:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-28 11:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558537da-2a36-5d8b-a659-8a62a7be1bb5 with scrape type 2
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558537da-2a36-5d8b-a659-8a62a7be1bb5 with scrape type 2
2026-03-28 11:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 558537da-2a36-5d8b-a659-8a62a7be1bb5, identifier: HL08327
2026-03-28 11:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-28 11:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-28 11:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327 to the API
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:15Z',
 'fuel_type': 'petrol',
 'id': '558537da-2a36-5d8b-a659-8a62a7be1bb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL08327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 96175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Saving data for HL08327: {'auction_closing_time': 1774714575.0, 'created_time': 1774607775.052663, 'last_price_update_time': 1774695718.233461}
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL08327') HTTP/1.1" 204 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for PM23375: 2
2026-03-28 11:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-28 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-28 11:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91f7cf98-31ce-5b5c-9c20-140c62704a58, identifier: PM23375
2026-03-28 11:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-28 11:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-28 11:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375 to the API
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:43:31Z',
 'fuel_type': 'diesel',
 'id': '91f7cf98-31ce-5b5c-9c20-140c62704a58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM23375',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 204176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-03',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Saving data for PM23375: {'auction_closing_time': 1774716211.0, 'created_time': 1774349164.412524, 'last_price_update_time': 1774695719.44155}
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM23375') HTTP/1.1" 204 0
2026-03-28 11:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for UZ37067: 2
2026-03-28 11:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-28 11:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5f763b-223d-5001-b5e9-af1e69743b56 with scrape type 2
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5f763b-223d-5001-b5e9-af1e69743b56 with scrape type 2
2026-03-28 11:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5f763b-223d-5001-b5e9-af1e69743b56, identifier: UZ37067
2026-03-28 11:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-28 11:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-28 11:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067 to the API
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:59Z',
 'fuel_type': 'petrol',
 'id': '4a5f763b-223d-5001-b5e9-af1e69743b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37067',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 95449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-11',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2020}
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Saving data for UZ37067: {'auction_closing_time': 1774715699.0, 'created_time': 1774607820.899124, 'last_price_update_time': 1774695719.901814}
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ37067') HTTP/1.1" 204 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for WY87564: 2
2026-03-28 11:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-28 11:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 2
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 2
2026-03-28 11:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b, identifier: WY87564
2026-03-28 11:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-28 11:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-28 11:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564 to the API
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:19:13Z',
 'fuel_type': 'petrol',
 'id': 'b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY87564',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 161857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Saving data for WY87564: {'auction_closing_time': 1774714753.0, 'created_time': 1774607763.032955, 'last_price_update_time': 1774695720.370647}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY87564') HTTP/1.1" 204 0
2026-03-28 11:02:00 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9697 | hits on page: 40
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for SC06812: 2
2026-03-28 11:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-28 11:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-28 11:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 714de284-560f-5487-aac2-29f81829d383, identifier: SC06812
2026-03-28 11:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-28 11:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-28 11:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812 to the API
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:57:55Z',
 'fuel_type': 'petrol',
 'id': '714de284-560f-5487-aac2-29f81829d383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC06812',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 68460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2019}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Saving data for SC06812: {'auction_closing_time': 1774717075.0, 'created_time': 1773917487.315556, 'last_price_update_time': 1774695720.805639}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC06812') HTTP/1.1" 204 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for FR92717: 2
2026-03-28 11:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-28 11:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 2
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf531ae-96c1-569c-a7c7-f12a6e59abd6, identifier: FR92717
2026-03-28 11:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:01 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Scrape type for YF78558: 2
2026-03-28 11:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-28 11:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209a5d1e-9028-5d3b-b29a-2381b4e0f067, identifier: YF78558
2026-03-28 11:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-28 11:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-28 11:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717 to the API
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:50Z',
 'fuel_type': 'diesel',
 'id': 'fcf531ae-96c1-569c-a7c7-f12a6e59abd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR92717',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 195183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Saving data for FR92717: {'auction_closing_time': 1774716650.0, 'created_time': 1774607875.210748, 'last_price_update_time': 1774695721.461632}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR92717') HTTP/1.1" 204 0
2026-03-28 11:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-28 11:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-28 11:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558 to the API
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:04Z',
 'fuel_type': 'diesel',
 'id': '209a5d1e-9028-5d3b-b29a-2381b4e0f067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF78558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 244679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Saving data for YF78558: {'auction_closing_time': 1774716124.0, 'created_time': 1774607831.562437, 'last_price_update_time': 1774695721.756515}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF78558') HTTP/1.1" 204 0
2026-03-28 11:02:01 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Scrape type for TA25367: 2
2026-03-28 11:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-28 11:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf71b327-e82d-5cef-afeb-feb0ae5d4c17, identifier: TA25367
2026-03-28 11:02:01 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 11:02:01 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA14502%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Scrape type for LA14502: 0
2026-03-28 11:02:01 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [auto1.de] INFO: Scrape type for GC05156: 2
2026-03-28 11:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-28 11:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 2
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 2
2026-03-28 11:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaedf7-0126-5c15-bf32-b3c3de23f139, identifier: GC05156
2026-03-28 11:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-28 11:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-28 11:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367 to the API
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:22:30Z',
 'fuel_type': 'petrol',
 'id': 'cf71b327-e82d-5cef-afeb-feb0ae5d4c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA25367',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 145336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 1998}
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-28 11:02:02 [auto1.de] INFO: Saving data for TA25367: {'auction_closing_time': 1774714950.0, 'created_time': 1774032971.618361, 'last_price_update_time': 1774695722.394963}
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA25367') HTTP/1.1" 204 0
2026-03-28 11:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-28 11:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-28 11:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156 to the API
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:00:49Z',
 'fuel_type': 'diesel',
 'id': '5cdaedf7-0126-5c15-bf32-b3c3de23f139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC05156',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 32485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-28 11:02:02 [auto1.de] INFO: Saving data for GC05156: {'auction_closing_time': 1774713649.0, 'created_time': 1774607777.330793, 'last_price_update_time': 1774695722.754762}
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC05156') HTTP/1.1" 204 0
2026-03-28 11:02:02 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-28 11:02:02 [auto1.de] INFO: Scrape type for RN18911: 2
2026-03-28 11:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-28 11:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with scrape type 2
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with scrape type 2
2026-03-28 11:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07, identifier: RN18911
2026-03-28 11:02:02 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-28 11:02:02 [auto1.de] INFO: Scrape type for GT57416: 2
2026-03-28 11:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-28 11:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 2
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 2
2026-03-28 11:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 586c1eaf-1f2e-59cf-8176-275edac29733, identifier: GT57416
2026-03-28 11:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-28 11:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-28 11:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911 to the API
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'petrol',
 'id': 'ae062b62-3809-5d5f-af3d-9fdbc9a3fa07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN18911',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 187175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-25',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-28 11:02:03 [auto1.de] INFO: Saving data for RN18911: {'auction_closing_time': 1774716427.0, 'created_time': 1774607769.543703, 'last_price_update_time': 1774695723.356679}
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN18911') HTTP/1.1" 204 0
2026-03-28 11:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-28 11:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-28 11:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416 to the API
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:06:03Z',
 'fuel_type': 'diesel',
 'id': '586c1eaf-1f2e-59cf-8176-275edac29733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT57416',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 170364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-03',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-28 11:02:03 [auto1.de] INFO: Saving data for GT57416: {'auction_closing_time': 1774713963.0, 'created_time': 1774607758.615614, 'last_price_update_time': 1774695723.67622}
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT57416') HTTP/1.1" 204 0
2026-03-28 11:02:03 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-28 11:02:03 [auto1.de] INFO: Scrape type for DF38507: 2
2026-03-28 11:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-28 11:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 2
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 2
2026-03-28 11:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799, identifier: DF38507
2026-03-28 11:02:03 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 11:02:03 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 11:02:03 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 11:02:03 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 11:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-28 11:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-28 11:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507 to the API
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:27:42Z',
 'fuel_type': 'petrol',
 'id': '60c9b00d-ce8a-59ae-aa80-3bbe06e03799',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF38507',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 40183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2016}
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Saving data for DF38507: {'auction_closing_time': 1774715262.0, 'created_time': 1774607754.534934, 'last_price_update_time': 1774695724.088225}
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF38507') HTTP/1.1" 204 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for SC10304: 2
2026-03-28 11:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-28 11:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9cb1bfe-f731-5341-8703-533cfdf0ce58 with scrape type 2
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9cb1bfe-f731-5341-8703-533cfdf0ce58 with scrape type 2
2026-03-28 11:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9cb1bfe-f731-5341-8703-533cfdf0ce58, identifier: SC10304
2026-03-28 11:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-28 11:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-28 11:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304 to the API
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:54Z',
 'fuel_type': 'petrol',
 'id': 'e9cb1bfe-f731-5341-8703-533cfdf0ce58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10304',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 41600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic Urban',
 'transmission': 'automatic',
 'trim': '4Matic Urban',
 'year': 2018}
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Saving data for SC10304: {'auction_closing_time': 1774715874.0, 'created_time': 1774607753.585845, 'last_price_update_time': 1774695724.668657}
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC10304') HTTP/1.1" 204 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for GM45973: 2
2026-03-28 11:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-28 11:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-28 11:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85a4af3a-454f-5c05-968d-10cbc315d670, identifier: GM45973
2026-03-28 11:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-28 11:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-28 11:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973 to the API
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:11:34Z',
 'fuel_type': 'diesel',
 'id': '85a4af3a-454f-5c05-968d-10cbc315d670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM45973',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 57890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H1 Control Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H1 Control Start&Stop',
 'year': 2021}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [auto1.de] INFO: Saving data for GM45973: {'auction_closing_time': 1774714294.0, 'created_time': 1773138765.659527, 'last_price_update_time': 1774695725.162626}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM45973') HTTP/1.1" 204 0
2026-03-28 11:02:05 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [auto1.de] INFO: Scrape type for YM57013: 2
2026-03-28 11:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-28 11:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 2
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 2
2026-03-28 11:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5964004e-ccba-5eb3-b356-c02efb1ccb3c, identifier: YM57013
2026-03-28 11:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-28 11:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-28 11:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013 to the API
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:31Z',
 'fuel_type': 'diesel',
 'id': '5964004e-ccba-5eb3-b356-c02efb1ccb3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM57013',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 211087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2017}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [auto1.de] INFO: Saving data for YM57013: {'auction_closing_time': 1774714171.0, 'created_time': 1774607764.271107, 'last_price_update_time': 1774695725.616956}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM57013') HTTP/1.1" 204 0
2026-03-28 11:02:05 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-28 11:02:05 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-28 11:02:05 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [auto1.de] INFO: Scrape type for VF83806: 2
2026-03-28 11:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-28 11:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 2
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 2
2026-03-28 11:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0ab5d1-9d66-5491-a417-b1c4ee15209c, identifier: VF83806
2026-03-28 11:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-28 11:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-28 11:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806 to the API
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:47:44Z',
 'fuel_type': 'diesel',
 'id': 'fe0ab5d1-9d66-5491-a417-b1c4ee15209c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF83806',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 178140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-28 11:02:06 [auto1.de] INFO: Saving data for VF83806: {'auction_closing_time': 1774716464.0, 'created_time': 1774607765.447724, 'last_price_update_time': 1774695726.069071}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF83806') HTTP/1.1" 204 0
2026-03-28 11:02:06 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 11:02:06 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-28 11:02:06 [auto1.de] INFO: Scrape type for AR33954: 2
2026-03-28 11:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-28 11:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-28 11:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ad8abe-1545-55e5-b297-bf0e512a54f4, identifier: AR33954
2026-03-28 11:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-28 11:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-28 11:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954 to the API
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'diesel',
 'id': '08ad8abe-1545-55e5-b297-bf0e512a54f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR33954',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 84126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2020}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-28 11:02:06 [auto1.de] INFO: Saving data for AR33954: {'auction_closing_time': 1774714335.0, 'created_time': 1773945914.401284, 'last_price_update_time': 1774695726.493138}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR33954') HTTP/1.1" 204 0
2026-03-28 11:02:06 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-28 11:02:06 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-28 11:02:06 [auto1.de] INFO: Scrape type for FL90187: 2
2026-03-28 11:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-28 11:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea48d560-4562-5752-a0ac-fde215f74872 with scrape type 2
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea48d560-4562-5752-a0ac-fde215f74872 with scrape type 2
2026-03-28 11:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea48d560-4562-5752-a0ac-fde215f74872, identifier: FL90187
2026-03-28 11:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-28 11:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-28 11:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187 to the API
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:17:56Z',
 'fuel_type': 'hybrid',
 'id': 'ea48d560-4562-5752-a0ac-fde215f74872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL90187',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 129751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-22',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2019}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-28 11:02:06 [auto1.de] INFO: Saving data for FL90187: {'auction_closing_time': 1774714676.0, 'created_time': 1774607757.700651, 'last_price_update_time': 1774695726.905497}
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL90187') HTTP/1.1" 204 0
2026-03-28 11:02:07 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [auto1.de] INFO: Scrape type for WB38942: 2
2026-03-28 11:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-28 11:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-28 11:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab, identifier: WB38942
2026-03-28 11:02:07 [scrapy.extensions.logstats] INFO: Crawled 411 pages (at 4 pages/min), scraped 393 items (at 67 items/min)
2026-03-28 11:02:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-28 11:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-28 11:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942 to the API
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:09:48Z',
 'fuel_type': 'diesel',
 'id': '2d45d5e5-db05-5086-b7f8-c10b9b19e8ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB38942',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 353125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2012}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [auto1.de] INFO: Saving data for WB38942: {'auction_closing_time': 1774714188.0, 'created_time': 1773830331.780469, 'last_price_update_time': 1774695727.433181}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB38942') HTTP/1.1" 204 0
2026-03-28 11:02:07 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [auto1.de] INFO: Scrape type for XT08525: 2
2026-03-28 11:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-28 11:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with scrape type 2
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with scrape type 2
2026-03-28 11:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7, identifier: XT08525
2026-03-28 11:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-28 11:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-28 11:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525 to the API
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:03:14Z',
 'fuel_type': 'diesel',
 'id': 'c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT08525',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 108800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [auto1.de] INFO: Saving data for XT08525: {'auction_closing_time': 1774713794.0, 'created_time': 1774607767.534763, 'last_price_update_time': 1774695727.895502}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT08525') HTTP/1.1" 204 0
2026-03-28 11:02:07 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [auto1.de] INFO: Scrape type for EX64550: 2
2026-03-28 11:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-28 11:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96bf7bc-b654-5b67-ae8d-f2637c251d53 with scrape type 2
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a96bf7bc-b654-5b67-ae8d-f2637c251d53 with scrape type 2
2026-03-28 11:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a96bf7bc-b654-5b67-ae8d-f2637c251d53, identifier: EX64550
2026-03-28 11:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-28 11:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-28 11:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550 to the API
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:18:38Z',
 'fuel_type': 'petrol',
 'id': 'a96bf7bc-b654-5b67-ae8d-f2637c251d53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX64550',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 123211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-28',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2003}
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-28 11:02:08 [auto1.de] INFO: Saving data for EX64550: {'auction_closing_time': 1774714718.0, 'created_time': 1774607773.03843, 'last_price_update_time': 1774695728.352431}
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX64550') HTTP/1.1" 204 0
2026-03-28 11:02:08 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-28 11:02:08 [auto1.de] INFO: Scrape type for FZ93202: 2
2026-03-28 11:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-28 11:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31069b09-bcbe-5f7f-8091-09b5f344c033 with scrape type 2
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31069b09-bcbe-5f7f-8091-09b5f344c033 with scrape type 2
2026-03-28 11:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31069b09-bcbe-5f7f-8091-09b5f344c033, identifier: FZ93202
2026-03-28 11:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-28 11:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-28 11:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202 to the API
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:13:15Z',
 'fuel_type': 'petrol',
 'id': '31069b09-bcbe-5f7f-8091-09b5f344c033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ93202',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 159776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-11',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 X Active',
 'transmission': 'automatic',
 'trim': 'X Active',
 'year': 2007}
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-28 11:02:08 [auto1.de] INFO: Saving data for FZ93202: {'auction_closing_time': 1774714395.0, 'created_time': 1774607837.2006, 'last_price_update_time': 1774695728.769554}
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ93202') HTTP/1.1" 204 0
2026-03-28 11:02:08 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 11:02:08 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 11:02:08 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-28 11:02:08 [auto1.de] INFO: Scrape type for ML20845: 2
2026-03-28 11:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-28 11:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2868b7-433f-50d8-ac6a-a958a1d92063 with scrape type 2
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f2868b7-433f-50d8-ac6a-a958a1d92063 with scrape type 2
2026-03-28 11:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f2868b7-433f-50d8-ac6a-a958a1d92063, identifier: ML20845
2026-03-28 11:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-28 11:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-28 11:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845 to the API
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:59:10Z',
 'fuel_type': 'petrol',
 'id': '3f2868b7-433f-50d8-ac6a-a958a1d92063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML20845',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 177919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-06',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2005}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-28 11:02:09 [auto1.de] INFO: Saving data for ML20845: {'auction_closing_time': 1774717150.0, 'created_time': 1774607760.561515, 'last_price_update_time': 1774695729.184487}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML20845') HTTP/1.1" 204 0
2026-03-28 11:02:09 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-28 11:02:09 [auto1.de] INFO: Scrape type for BN78852: 2
2026-03-28 11:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-28 11:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 2
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 2
2026-03-28 11:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef4403a-87cf-5d9e-aad1-dc958444df3d, identifier: BN78852
2026-03-28 11:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-28 11:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-28 11:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852 to the API
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:57:37Z',
 'fuel_type': 'diesel',
 'id': '9ef4403a-87cf-5d9e-aad1-dc958444df3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN78852',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 55493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2019}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-28 11:02:09 [auto1.de] INFO: Saving data for BN78852: {'auction_closing_time': 1774717057.0, 'created_time': 1774607772.607082, 'last_price_update_time': 1774695729.612936}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN78852') HTTP/1.1" 204 0
2026-03-28 11:02:09 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-28 11:02:09 [auto1.de] INFO: Scrape type for ZT20326: 2
2026-03-28 11:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-28 11:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-28 11:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afe77dfe-c652-540f-b195-1447fbd1f5cc, identifier: ZT20326
2026-03-28 11:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-28 11:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-28 11:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326 to the API
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:45:08Z',
 'fuel_type': 'petrol',
 'id': 'afe77dfe-c652-540f-b195-1447fbd1f5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT20326',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 75169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-05',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion Tech',
 'year': 2014}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [auto1.de] INFO: Saving data for ZT20326: {'auction_closing_time': 1774716308.0, 'created_time': 1774349331.688643, 'last_price_update_time': 1774695730.098757}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT20326') HTTP/1.1" 204 0
2026-03-28 11:02:10 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG97349%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [auto1.de] INFO: Scrape type for VG97349: 0
2026-03-28 11:02:10 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-28 11:02:10 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-28 11:02:10 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [auto1.de] INFO: Scrape type for WS02654: 2
2026-03-28 11:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-28 11:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-28 11:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a282c06c-f36b-50ae-b469-6f7f7bcb88a4, identifier: WS02654
2026-03-28 11:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-28 11:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-28 11:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654 to the API
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:29:30Z',
 'fuel_type': 'petrol',
 'id': 'a282c06c-f36b-50ae-b469-6f7f7bcb88a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS02654',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 162563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-31',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2018}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [auto1.de] INFO: Saving data for WS02654: {'auction_closing_time': 1774715370.0, 'created_time': 1773830386.763692, 'last_price_update_time': 1774695730.680471}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS02654') HTTP/1.1" 204 0
2026-03-28 11:02:10 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [auto1.de] INFO: Scrape type for VB62953: 2
2026-03-28 11:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-28 11:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-28 11:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6368ec0b-2807-54e6-8004-70afefba5de6, identifier: VB62953
2026-03-28 11:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-28 11:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-28 11:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953 to the API
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:52Z',
 'fuel_type': 'diesel',
 'id': '6368ec0b-2807-54e6-8004-70afefba5de6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB62953',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 138384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [auto1.de] INFO: Saving data for VB62953: {'auction_closing_time': 1774716832.0, 'created_time': 1773304889.673313, 'last_price_update_time': 1774695731.259613}
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB62953') HTTP/1.1" 204 0
2026-03-28 11:02:11 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [auto1.de] INFO: Scrape type for LE21956: 2
2026-03-28 11:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-28 11:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-28 11:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: accea6fc-5443-5750-909d-52739c987d57, identifier: LE21956
2026-03-28 11:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-28 11:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-28 11:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956 to the API
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'petrol',
 'id': 'accea6fc-5443-5750-909d-52739c987d57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21956',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 85475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2011}
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [auto1.de] INFO: Saving data for LE21956: {'auction_closing_time': 1774714041.0, 'created_time': 1774032665.6297, 'last_price_update_time': 1774695731.72645}
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE21956') HTTP/1.1" 204 0
2026-03-28 11:02:11 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:11 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 11:02:11 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 11:02:11 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 11:02:11 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [auto1.de] INFO: Scrape type for EY23363: 2
2026-03-28 11:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-28 11:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-28 11:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce794b4e-dd87-54f2-ad08-1756f787878e, identifier: EY23363
2026-03-28 11:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-28 11:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-28 11:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363 to the API
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:19:23Z',
 'fuel_type': 'petrol',
 'id': 'ce794b4e-dd87-54f2-ad08-1756f787878e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY23363',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 41202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2021}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-28 11:02:12 [auto1.de] INFO: Saving data for EY23363: {'auction_closing_time': 1774714763.0, 'created_time': 1774292904.383755, 'last_price_update_time': 1774695732.207435}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY23363') HTTP/1.1" 204 0
2026-03-28 11:02:12 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 11:02:12 [auto1.de] INFO: Scrape type for PY44699: 2
2026-03-28 11:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-28 11:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-28 11:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-28 11:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 474b78af-e5ba-54c8-800f-6af4b57192ec, identifier: PY44699
2026-03-28 11:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:12 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-28 11:02:12 [auto1.de] INFO: Scrape type for MU47356: 2
2026-03-28 11:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-28 11:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-28 11:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-28 11:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 413eb418-b3b2-5960-868b-079f17a54777, identifier: MU47356
2026-03-28 11:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-28 11:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-28 11:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699 to the API
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:35:38Z',
 'fuel_type': 'diesel',
 'id': '474b78af-e5ba-54c8-800f-6af4b57192ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY44699',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 23314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-26',
 'seller_name': None,
 'title': 'Ford Transit Courier 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2020}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 11:02:12 [auto1.de] INFO: Saving data for PY44699: {'auction_closing_time': 1774715738.0, 'created_time': 1773341709.910902, 'last_price_update_time': 1774695732.854706}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY44699') HTTP/1.1" 204 0
2026-03-28 11:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-28 11:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-28 11:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356 to the API
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:20:53Z',
 'fuel_type': 'diesel',
 'id': '413eb418-b3b2-5960-868b-079f17a54777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU47356',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 128572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2016}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Saving data for MU47356: {'auction_closing_time': 1774714853.0, 'created_time': 1773829837.628076, 'last_price_update_time': 1774695733.155797}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU47356') HTTP/1.1" 204 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for ZV33449: 2
2026-03-28 11:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-28 11:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae156ef9-371c-5370-bf9d-2c672c632ab4 with scrape type 2
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae156ef9-371c-5370-bf9d-2c672c632ab4 with scrape type 2
2026-03-28 11:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae156ef9-371c-5370-bf9d-2c672c632ab4, identifier: ZV33449
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for FL14438: 2
2026-03-28 11:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-28 11:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-28 11:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d34bb06-5c77-5c64-be75-da7c4f38efa5, identifier: FL14438
2026-03-28 11:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-28 11:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-28 11:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449 to the API
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:25:40Z',
 'fuel_type': 'diesel',
 'id': 'ae156ef9-371c-5370-bf9d-2c672c632ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV33449',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 230861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-12',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Saving data for ZV33449: {'auction_closing_time': 1774715140.0, 'created_time': 1774607835.145952, 'last_price_update_time': 1774695733.792165}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV33449') HTTP/1.1" 204 0
2026-03-28 11:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-28 11:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-28 11:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438 to the API
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:11Z',
 'fuel_type': 'diesel',
 'id': '9d34bb06-5c77-5c64-be75-da7c4f38efa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL14438',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Fluence',
 'odometer': 329503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-02',
 'seller_name': None,
 'title': 'Renault Fluence 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-28 11:02:14 [auto1.de] INFO: Saving data for FL14438: {'auction_closing_time': 1774713791.0, 'created_time': 1774330255.221785, 'last_price_update_time': 1774695734.198048}
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL14438') HTTP/1.1" 204 0
2026-03-28 11:02:14 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-28 11:02:14 [auto1.de] INFO: Scrape type for SA55190: 2
2026-03-28 11:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-28 11:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-28 11:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ccec49b-106e-53b5-b1e6-60345b9a4557, identifier: SA55190
2026-03-28 11:02:14 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-28 11:02:14 [auto1.de] INFO: Scrape type for HA69467: 2
2026-03-28 11:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-28 11:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-28 11:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 845139da-8c86-582d-bffc-6ea08e9ae60d, identifier: HA69467
2026-03-28 11:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-28 11:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-28 11:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190 to the API
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'petrol',
 'id': '8ccec49b-106e-53b5-b1e6-60345b9a4557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA55190',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 154146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active ecoFlex',
 'transmission': 'manual',
 'trim': 'Active ecoFlex',
 'year': 2017}
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-28 11:02:14 [auto1.de] INFO: Saving data for SA55190: {'auction_closing_time': 1774715125.0, 'created_time': 1774293887.370727, 'last_price_update_time': 1774695734.745355}
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA55190') HTTP/1.1" 204 0
2026-03-28 11:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-28 11:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-28 11:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467 to the API
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:01:45Z',
 'fuel_type': 'diesel',
 'id': '845139da-8c86-582d-bffc-6ea08e9ae60d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA69467',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 184389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Saving data for HA69467: {'auction_closing_time': 1774713705.0, 'created_time': 1773859427.344956, 'last_price_update_time': 1774695735.060796}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA69467') HTTP/1.1" 204 0
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Scrape type for JK17459: 2
2026-03-28 11:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-28 11:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-28 11:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5398c5e1-fcde-5d4b-bf2f-c44038dca325, identifier: JK17459
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-28 11:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-28 11:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-28 11:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459 to the API
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:47Z',
 'fuel_type': 'diesel',
 'id': '5398c5e1-fcde-5d4b-bf2f-c44038dca325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK17459',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vaneo',
 'odometer': 113495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-15',
 'seller_name': None,
 'title': 'Mercedes-Benz Vaneo 1.7 CDI Family',
 'transmission': 'automatic',
 'trim': 'Family',
 'year': 2003}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Saving data for JK17459: {'auction_closing_time': 1774715327.0, 'created_time': 1774294742.310111, 'last_price_update_time': 1774695735.495115}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK17459') HTTP/1.1" 204 0
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Scrape type for HG45518: 2
2026-03-28 11:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-28 11:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-28 11:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5, identifier: HG45518
2026-03-28 11:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-28 11:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-28 11:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518 to the API
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:22Z',
 'fuel_type': 'petrol',
 'id': '2ecdc16d-6221-593c-8b9b-82bfd63f53d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG45518',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 75207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TGI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Saving data for HG45518: {'auction_closing_time': 1774716622.0, 'created_time': 1773772232.947375, 'last_price_update_time': 1774695735.913285}
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG45518') HTTP/1.1" 204 0
2026-03-28 11:02:15 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-28 11:02:15 [auto1.de] INFO: Scrape type for KR60146: 2
2026-03-28 11:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-28 11:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-28 11:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfbee945-89c8-53eb-8fb7-57c7da1b062e, identifier: KR60146
2026-03-28 11:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-28 11:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-28 11:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146 to the API
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:02:25Z',
 'fuel_type': 'petrol',
 'id': 'cfbee945-89c8-53eb-8fb7-57c7da1b062e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR60146',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 26620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-04',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2020}
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-28 11:02:16 [auto1.de] INFO: Saving data for KR60146: {'auction_closing_time': 1774713745.0, 'created_time': 1773341652.793142, 'last_price_update_time': 1774695736.334765}
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR60146') HTTP/1.1" 204 0
2026-03-28 11:02:16 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 11:02:16 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 11:02:16 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-28 11:02:16 [auto1.de] INFO: Scrape type for CA31330: 2
2026-03-28 11:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-28 11:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de4112cf-cd3d-5ee8-aab4-809ff0869882 with scrape type 2
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de4112cf-cd3d-5ee8-aab4-809ff0869882 with scrape type 2
2026-03-28 11:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de4112cf-cd3d-5ee8-aab4-809ff0869882, identifier: CA31330
2026-03-28 11:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-28 11:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-28 11:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330 to the API
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'diesel',
 'id': 'de4112cf-cd3d-5ee8-aab4-809ff0869882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA31330',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 112392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-28 11:02:16 [auto1.de] INFO: Saving data for CA31330: {'auction_closing_time': 1774714236.0, 'created_time': 1774292887.303277, 'last_price_update_time': 1774695736.73486}
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA31330') HTTP/1.1" 204 0
2026-03-28 11:02:16 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-28 11:02:16 [auto1.de] INFO: Scrape type for SX60280: 2
2026-03-28 11:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-28 11:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-28 11:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004, identifier: SX60280
2026-03-28 11:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-28 11:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-28 11:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280 to the API
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:57Z',
 'fuel_type': 'diesel',
 'id': '32bf8a2f-1a89-505d-b885-8a4c8cc1b004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX60280',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 161650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
 'transmission': 'manual',
 'trim': 'Evalia Tekna',
 'year': 2013}
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-28 11:02:17 [auto1.de] INFO: Saving data for SX60280: {'auction_closing_time': 1774715397.0, 'created_time': 1773426936.082551, 'last_price_update_time': 1774695737.226396}
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX60280') HTTP/1.1" 204 0
2026-03-28 11:02:17 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 11:02:17 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-28 11:02:17 [auto1.de] INFO: Scrape type for UU73518: 2
2026-03-28 11:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-28 11:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-28 11:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-28 11:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1, identifier: UU73518
2026-03-28 11:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-28 11:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-28 11:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518 to the API
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:20Z',
 'fuel_type': 'petrol',
 'id': 'abb51e5e-6e00-5c20-9c6e-b68e2b8154a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU73518',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 200590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2015}
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-28 11:02:17 [auto1.de] INFO: Saving data for UU73518: {'auction_closing_time': 1774715000.0, 'created_time': 1773685900.575337, 'last_price_update_time': 1774695737.662477}
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU73518') HTTP/1.1" 204 0
2026-03-28 11:02:17 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-28 11:02:17 [auto1.de] INFO: Scrape type for UM95943: 2
2026-03-28 11:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-28 11:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-28 11:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-28 11:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f706def7-857d-5d05-82c1-9b0ada2e70be, identifier: UM95943
2026-03-28 11:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-28 11:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-28 11:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943 to the API
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:51:51Z',
 'fuel_type': 'petrol',
 'id': 'f706def7-857d-5d05-82c1-9b0ada2e70be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95943',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 107240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2016}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Saving data for UM95943: {'auction_closing_time': 1774716711.0, 'created_time': 1774290721.434664, 'last_price_update_time': 1774695738.111458}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM95943') HTTP/1.1" 204 0
2026-03-28 11:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Scrape type for PF67152: 2
2026-03-28 11:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-28 11:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3915990-984b-54de-bca3-12bde127017a, identifier: PF67152
2026-03-28 11:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-28 11:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-28 11:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152 to the API
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:12Z',
 'fuel_type': 'diesel',
 'id': 'd3915990-984b-54de-bca3-12bde127017a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF67152',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 257745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-19',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Saving data for PF67152: {'auction_closing_time': 1774715772.0, 'created_time': 1774294233.663818, 'last_price_update_time': 1774695738.552756}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF67152') HTTP/1.1" 204 0
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 11:02:18 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Scrape type for JK31212: 2
2026-03-28 11:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-28 11:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bec0fae5-44c1-585d-a155-88ba83a17202, identifier: JK31212
2026-03-28 11:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-28 11:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-28 11:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212 to the API
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:34:39Z',
 'fuel_type': 'petrol',
 'id': 'bec0fae5-44c1-585d-a155-88ba83a17202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK31212',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 82790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-08',
 'seller_name': None,
 'title': 'Audi A6 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [auto1.de] INFO: Saving data for JK31212: {'auction_closing_time': 1774715679.0, 'created_time': 1773687366.318032, 'last_price_update_time': 1774695738.986008}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK31212') HTTP/1.1" 204 0
2026-03-28 11:02:19 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.de] INFO: Scrape type for XR58128: 2
2026-03-28 11:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-28 11:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2fd21e0-790d-5d3a-a691-437ce04a69c8, identifier: XR58128
2026-03-28 11:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-28 11:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-28 11:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128 to the API
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:00:10Z',
 'fuel_type': 'diesel',
 'id': 'a2fd21e0-790d-5d3a-a691-437ce04a69c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR58128',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 160999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Multivan Generation Six 4Motion',
 'year': 2016}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.de] INFO: Saving data for XR58128: {'auction_closing_time': 1774713610.0, 'created_time': 1774263264.809831, 'last_price_update_time': 1774695739.547249}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR58128') HTTP/1.1" 204 0
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.de] INFO: Scrape type for AL71232: 2
2026-03-28 11:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-28 11:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b7451f4-d5f3-51cb-8269-84453813d405, identifier: AL71232
2026-03-28 11:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 11:02:19 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.de] INFO: Scrape type for ZU59417: 2
2026-03-28 11:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-28 11:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d, identifier: ZU59417
2026-03-28 11:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-28 11:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-28 11:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232 to the API
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'petrol',
 'id': '1b7451f4-d5f3-51cb-8269-84453813d405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL71232',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 129595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-04',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [auto1.de] INFO: Saving data for AL71232: {'auction_closing_time': 1774714484.0, 'created_time': 1773859369.203921, 'last_price_update_time': 1774695740.116856}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL71232') HTTP/1.1" 204 0
2026-03-28 11:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-28 11:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-28 11:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417 to the API
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:34:12Z',
 'fuel_type': 'petrol',
 'id': '8407425c-0f4f-5956-89f3-e7d9d7d49a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU59417',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 73259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [auto1.de] INFO: Saving data for ZU59417: {'auction_closing_time': 1774715652.0, 'created_time': 1774290961.666728, 'last_price_update_time': 1774695740.409251}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU59417') HTTP/1.1" 204 0
2026-03-28 11:02:20 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [auto1.de] INFO: Scrape type for PH16330: 2
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a985feb1-4c09-50c0-8023-e8f1c7394cd4, identifier: PH16330
2026-03-28 11:02:20 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 11:02:20 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [auto1.de] INFO: Scrape type for LX86336: 2
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667ce6bf-58de-515c-98fa-e28fac7675bb, identifier: LX86336
2026-03-28 11:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-28 11:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-28 11:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330 to the API
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:26:23Z',
 'fuel_type': 'diesel',
 'id': 'a985feb1-4c09-50c0-8023-e8f1c7394cd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH16330',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 123118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2021}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.de] INFO: Saving data for PH16330: {'auction_closing_time': 1774715183.0, 'created_time': 1773304371.014517, 'last_price_update_time': 1774695741.002467}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH16330') HTTP/1.1" 204 0
2026-03-28 11:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-28 11:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-28 11:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336 to the API
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:43:17Z',
 'fuel_type': 'petrol',
 'id': '667ce6bf-58de-515c-98fa-e28fac7675bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX86336',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 49143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.de] INFO: Saving data for LX86336: {'auction_closing_time': 1774716197.0, 'created_time': 1774291167.36695, 'last_price_update_time': 1774695741.311918}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX86336') HTTP/1.1" 204 0
2026-03-28 11:02:21 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 11:02:21 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 11:02:21 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.de] INFO: Scrape type for BJ03907: 2
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a535f07-fa4a-5c06-bf25-732891dafc2c, identifier: BJ03907
2026-03-28 11:02:21 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.de] INFO: Scrape type for HK68029: 2
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f108aaeb-517f-52f2-8ade-454bd505c4d0, identifier: HK68029
2026-03-28 11:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-28 11:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-28 11:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907 to the API
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:14:59Z',
 'fuel_type': 'petrol',
 'id': '1a535f07-fa4a-5c06-bf25-732891dafc2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ03907',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 187156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-07-19',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.de] INFO: Saving data for BJ03907: {'auction_closing_time': 1774714499.0, 'created_time': 1774292268.597958, 'last_price_update_time': 1774695741.825732}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ03907') HTTP/1.1" 204 0
2026-03-28 11:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-28 11:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-28 11:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029 to the API
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:27:11Z',
 'fuel_type': 'diesel',
 'id': 'f108aaeb-517f-52f2-8ade-454bd505c4d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK68029',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 363136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.de] INFO: Saving data for HK68029: {'auction_closing_time': 1774715231.0, 'created_time': 1773687853.882407, 'last_price_update_time': 1774695742.242598}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK68029') HTTP/1.1" 204 0
2026-03-28 11:02:22 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.de] INFO: Scrape type for HH61225: 2
2026-03-28 11:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-28 11:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23ab9583-c06e-5ff2-a854-fb39b6a05c87, identifier: HH61225
2026-03-28 11:02:22 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 11:02:22 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 11:02:22 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.de] INFO: Scrape type for GY96570: 2
2026-03-28 11:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-28 11:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b4a116-f55d-5e49-aa23-c6dbf61b2494, identifier: GY96570
2026-03-28 11:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-28 11:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-28 11:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225 to the API
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:46Z',
 'fuel_type': 'petrol',
 'id': '23ab9583-c06e-5ff2-a854-fb39b6a05c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH61225',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 70204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-11',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Special 4x4',
 'transmission': 'manual',
 'trim': 'Special 4x4',
 'year': 2002}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.de] INFO: Saving data for HH61225: {'auction_closing_time': 1774716466.0, 'created_time': 1773305128.605758, 'last_price_update_time': 1774695742.820609}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH61225') HTTP/1.1" 204 0
2026-03-28 11:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-28 11:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-28 11:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570 to the API
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'diesel',
 'id': 'a9b4a116-f55d-5e49-aa23-c6dbf61b2494',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY96570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 82447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.de] INFO: Saving data for GY96570: {'auction_closing_time': 1774716741.0, 'created_time': 1773307460.528637, 'last_price_update_time': 1774695743.203209}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY96570') HTTP/1.1" 204 0
2026-03-28 11:02:23 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 11:02:23 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.de] INFO: Scrape type for CC89371: 2
2026-03-28 11:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-28 11:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 890ec45a-502a-5db8-9b63-0c20285237bf, identifier: CC89371
2026-03-28 11:02:23 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.de] INFO: Scrape type for EG34201: 2
2026-03-28 11:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-28 11:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedc9dc1-37d8-58bf-a424-2b2ac84e9701, identifier: EG34201
2026-03-28 11:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-28 11:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-28 11:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371 to the API
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:05:48Z',
 'fuel_type': 'petrol',
 'id': '890ec45a-502a-5db8-9b63-0c20285237bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89371',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.de] INFO: Saving data for CC89371: {'auction_closing_time': 1774713948.0, 'created_time': 1773301802.505674, 'last_price_update_time': 1774695743.725549}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89371') HTTP/1.1" 204 0
2026-03-28 11:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-28 11:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-28 11:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201 to the API
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:22Z',
 'fuel_type': 'petrol',
 'id': 'bedc9dc1-37d8-58bf-a424-2b2ac84e9701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG34201',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 191827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSIe',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.de] INFO: Saving data for EG34201: {'auction_closing_time': 1774716142.0, 'created_time': 1773776371.311434, 'last_price_update_time': 1774695744.115707}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG34201') HTTP/1.1" 204 0
2026-03-28 11:02:24 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.de] INFO: Scrape type for VG26326: 2
2026-03-28 11:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-28 11:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2b12821-e98c-521d-9438-a452a39ba8ea, identifier: VG26326
2026-03-28 11:02:24 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 11:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-28 11:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-28 11:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326 to the API
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:53Z',
 'fuel_type': 'petrol',
 'id': 'd2b12821-e98c-521d-9438-a452a39ba8ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG26326',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 129395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-08',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2016}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.de] INFO: Saving data for VG26326: {'auction_closing_time': 1774716053.0, 'created_time': 1773859845.04371, 'last_price_update_time': 1774695744.524515}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG26326') HTTP/1.1" 204 0
2026-03-28 11:02:24 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.de] INFO: Scrape type for LL88784: 2
2026-03-28 11:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-28 11:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b, identifier: LL88784
2026-03-28 11:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-28 11:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-28 11:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784 to the API
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'diesel',
 'id': '2bb58457-c95d-57d1-9ec3-bdc02cd1834b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL88784',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 140622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2011}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.de] INFO: Saving data for LL88784: {'auction_closing_time': 1774715238.0, 'created_time': 1773304838.315517, 'last_price_update_time': 1774695745.000581}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL88784') HTTP/1.1" 204 0
2026-03-28 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:25 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-28 11:02:25 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.de] INFO: Scrape type for XC17243: 2
2026-03-28 11:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-28 11:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea6f3cf5-df17-5907-9c4d-a6074d92f54e, identifier: XC17243
2026-03-28 11:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-28 11:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-28 11:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243 to the API
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:18Z',
 'fuel_type': 'petrol',
 'id': 'ea6f3cf5-df17-5907-9c4d-a6074d92f54e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC17243',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 112748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2011}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.de] INFO: Saving data for XC17243: {'auction_closing_time': 1774715418.0, 'created_time': 1774032301.563577, 'last_price_update_time': 1774695745.421504}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC17243') HTTP/1.1" 204 0
2026-03-28 11:02:25 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.de] INFO: Scrape type for HW66490: 2
2026-03-28 11:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-28 11:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a79375-40fa-520a-81d8-6cc5623e8131 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00a79375-40fa-520a-81d8-6cc5623e8131 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00a79375-40fa-520a-81d8-6cc5623e8131, identifier: HW66490
2026-03-28 11:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-28 11:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-28 11:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490 to the API
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'petrol',
 'id': '00a79375-40fa-520a-81d8-6cc5623e8131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW66490',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 101611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2022}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.de] INFO: Saving data for HW66490: {'auction_closing_time': 1774715736.0, 'created_time': 1774291116.770528, 'last_price_update_time': 1774695745.995412}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW66490') HTTP/1.1" 204 0
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Scrape type for HZ19691: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4577fdf0-59b6-5052-89c2-6ff6a7859fac, identifier: HZ19691
2026-03-28 11:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-28 11:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-28 11:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691 to the API
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:28:17Z',
 'fuel_type': 'petrol',
 'id': '4577fdf0-59b6-5052-89c2-6ff6a7859fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19691',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 90769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2018}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Saving data for HZ19691: {'auction_closing_time': 1774715297.0, 'created_time': 1773304413.250211, 'last_price_update_time': 1774695746.407858}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ19691') HTTP/1.1" 204 0
2026-03-28 11:02:26 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Scrape type for PZ27483: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db87229-e7e8-562d-adfc-6d731d6ae341, identifier: PZ27483
2026-03-28 11:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-28 11:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-28 11:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483 to the API
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:05:00Z',
 'fuel_type': 'petrol',
 'id': '3db87229-e7e8-562d-adfc-6d731d6ae341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ27483',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 130949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Saving data for PZ27483: {'auction_closing_time': 1774713900.0, 'created_time': 1774262269.053473, 'last_price_update_time': 1774695746.819212}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ27483') HTTP/1.1" 204 0
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Scrape type for TX48260: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87f618ff-196d-5724-85d8-948e6e3a204d, identifier: TX48260
2026-03-28 11:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 11:02:26 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.de] INFO: Scrape type for ZK39912: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df8e66fe-d663-5c2a-bba9-abd09e0007a5, identifier: ZK39912
2026-03-28 11:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-28 11:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-28 11:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260 to the API
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:34Z',
 'fuel_type': 'petrol',
 'id': '87f618ff-196d-5724-85d8-948e6e3a204d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX48260',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 93317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.de] INFO: Saving data for TX48260: {'auction_closing_time': 1774715194.0, 'created_time': 1773775665.179603, 'last_price_update_time': 1774695747.353523}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX48260') HTTP/1.1" 204 0
2026-03-28 11:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-28 11:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-28 11:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912 to the API
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:58:48Z',
 'fuel_type': 'petrol',
 'id': 'df8e66fe-d663-5c2a-bba9-abd09e0007a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK39912',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 40337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Star',
 'transmission': 'manual',
 'trim': 'Star',
 'year': 2020}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.de] INFO: Saving data for ZK39912: {'auction_closing_time': 1774717128.0, 'created_time': 1773776283.539138, 'last_price_update_time': 1774695747.644215}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK39912') HTTP/1.1" 204 0
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.de] INFO: Scrape type for KU06936: 2
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e0ff56-806a-53e8-9e67-fdf22c61f278 with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01e0ff56-806a-53e8-9e67-fdf22c61f278 with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01e0ff56-806a-53e8-9e67-fdf22c61f278, identifier: KU06936
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 11:02:27 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.de] INFO: Scrape type for DD89889: 2
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ed6afe-0712-5583-a823-4a52200bdc65, identifier: DD89889
2026-03-28 11:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-28 11:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-28 11:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936 to the API
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:05:54Z',
 'fuel_type': 'diesel',
 'id': '01e0ff56-806a-53e8-9e67-fdf22c61f278',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU06936',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 179124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Edition Start/Stop',
 'transmission': 'automatic',
 'trim': 'Edition Start/Stop',
 'year': 2019}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.de] INFO: Saving data for KU06936: {'auction_closing_time': 1774713954.0, 'created_time': 1774291849.674869, 'last_price_update_time': 1774695748.19386}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU06936') HTTP/1.1" 204 0
2026-03-28 11:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-28 11:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-28 11:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889 to the API
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:04Z',
 'fuel_type': 'diesel',
 'id': '08ed6afe-0712-5583-a823-4a52200bdc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD89889',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 130421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2018}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.de] INFO: Saving data for DD89889: {'auction_closing_time': 1774716424.0, 'created_time': 1773428106.334032, 'last_price_update_time': 1774695748.579848}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD89889') HTTP/1.1" 204 0
2026-03-28 11:02:28 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 11:02:28 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.de] INFO: Scrape type for KM87247: 2
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aa9a06-e694-58a4-a7c0-309cbe26e86f, identifier: KM87247
2026-03-28 11:02:28 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.de] INFO: Scrape type for TK47054: 2
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85f890be-beaa-5096-8c2e-ed046630c7f4, identifier: TK47054
2026-03-28 11:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-28 11:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-28 11:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247 to the API
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:49:17Z',
 'fuel_type': 'diesel',
 'id': '15aa9a06-e694-58a4-a7c0-309cbe26e86f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM87247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 85106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.de] INFO: Saving data for KM87247: {'auction_closing_time': 1774716557.0, 'created_time': 1774330259.104166, 'last_price_update_time': 1774695749.156325}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM87247') HTTP/1.1" 204 0
2026-03-28 11:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-28 11:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-28 11:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054 to the API
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 557,
 'expiration_date': '2026-03-28T16:02:15Z',
 'fuel_type': 'petrol',
 'id': '85f890be-beaa-5096-8c2e-ed046630c7f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK47054',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 186704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 63 AMG 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2015}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.de] INFO: Saving data for TK47054: {'auction_closing_time': 1774713735.0, 'created_time': 1773776264.054683, 'last_price_update_time': 1774695749.505804}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK47054') HTTP/1.1" 204 0
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.de] INFO: Scrape type for PS47170: 2
2026-03-28 11:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-28 11:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b19f91f-080b-5ab6-9076-724827ca0d6f, identifier: PS47170
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 11:02:29 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.de] INFO: Scrape type for GL59385: 2
2026-03-28 11:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-28 11:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e074518-5d14-54b4-b821-d65b44f668a9, identifier: GL59385
2026-03-28 11:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-28 11:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-28 11:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170 to the API
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:47Z',
 'fuel_type': 'petrol',
 'id': '1b19f91f-080b-5ab6-9076-724827ca0d6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS47170',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 167989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-01',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2014}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.de] INFO: Saving data for PS47170: {'auction_closing_time': 1774716167.0, 'created_time': 1773426834.292713, 'last_price_update_time': 1774695750.113404}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS47170') HTTP/1.1" 204 0
2026-03-28 11:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-28 11:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-28 11:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385 to the API
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:03:11Z',
 'fuel_type': 'petrol',
 'id': '8e074518-5d14-54b4-b821-d65b44f668a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59385',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 106564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2009}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.de] INFO: Saving data for GL59385: {'auction_closing_time': 1774713791.0, 'created_time': 1773340756.345513, 'last_price_update_time': 1774695750.436739}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL59385') HTTP/1.1" 204 0
2026-03-28 11:02:30 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.de] INFO: Scrape type for NN29334: 2
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7543008b-9019-5f5c-96b2-13aaa0953c8b with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7543008b-9019-5f5c-96b2-13aaa0953c8b with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7543008b-9019-5f5c-96b2-13aaa0953c8b, identifier: NN29334
2026-03-28 11:02:30 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 11:02:30 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 11:02:30 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 11:02:30 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.de] INFO: Scrape type for FF62684: 2
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 215e824f-a442-5a7a-b2ec-75faf13aca6f, identifier: FF62684
2026-03-28 11:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-28 11:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-28 11:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334 to the API
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:21:35Z',
 'fuel_type': 'petrol',
 'id': '7543008b-9019-5f5c-96b2-13aaa0953c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN29334',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 60396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'Kia Venga 1.6 UEFA Euro 2016',
 'transmission': 'automatic',
 'trim': 'UEFA Euro 2016',
 'year': 2016}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.de] INFO: Saving data for NN29334: {'auction_closing_time': 1774714895.0, 'created_time': 1774293442.199332, 'last_price_update_time': 1774695750.946927}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN29334') HTTP/1.1" 204 0
2026-03-28 11:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-28 11:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-28 11:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684 to the API
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:10:44Z',
 'fuel_type': 'petrol',
 'id': '215e824f-a442-5a7a-b2ec-75faf13aca6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF62684',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 103952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Beats',
 'transmission': 'manual',
 'trim': 'Beats',
 'year': 2016}
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.de] INFO: Saving data for FF62684: {'auction_closing_time': 1774714244.0, 'created_time': 1773859767.788987, 'last_price_update_time': 1774695751.604018}
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF62684') HTTP/1.1" 204 0
2026-03-28 11:02:31 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 11:02:31 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.de] INFO: Scrape type for EV39961: 2
2026-03-28 11:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-28 11:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35dd651d-25d2-52be-913b-63460085253b, identifier: EV39961
2026-03-28 11:02:31 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.de] INFO: Scrape type for NS47503: 2
2026-03-28 11:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-28 11:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a, identifier: NS47503
2026-03-28 11:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-28 11:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-28 11:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961 to the API
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:35:54Z',
 'fuel_type': 'diesel',
 'id': '35dd651d-25d2-52be-913b-63460085253b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV39961',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 278053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Saving data for EV39961: {'auction_closing_time': 1774715754.0, 'created_time': 1773308136.069192, 'last_price_update_time': 1774695752.160394}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV39961') HTTP/1.1" 204 0
2026-03-28 11:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-28 11:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-28 11:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503 to the API
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:18:00Z',
 'fuel_type': 'diesel',
 'id': '6b89ff2f-91d0-5d9b-a384-66cb3c07d38a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS47503',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 256494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-25',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Saving data for NS47503: {'auction_closing_time': 1774714680.0, 'created_time': 1773306347.091123, 'last_price_update_time': 1774695752.473436}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS47503') HTTP/1.1" 204 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for WY91699: 2
2026-03-28 11:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-28 11:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-28 11:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2509d74f-8f1e-53b2-bb45-a01d12da881a, identifier: WY91699
2026-03-28 11:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-28 11:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-28 11:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699 to the API
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:35:34Z',
 'fuel_type': 'diesel',
 'id': '2509d74f-8f1e-53b2-bb45-a01d12da881a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY91699',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 279012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Saving data for WY91699: {'auction_closing_time': 1774715734.0, 'created_time': 1774292227.344446, 'last_price_update_time': 1774695752.940953}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY91699') HTTP/1.1" 204 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for SR51449: 2
2026-03-28 11:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-28 11:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2, identifier: SR51449
2026-03-28 11:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-28 11:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-28 11:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449 to the API
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:43Z',
 'fuel_type': 'gas',
 'id': '8c21292a-26b5-5ba9-a20f-dfc5c034abd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR51449',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 165129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI g-tron Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.de] INFO: Saving data for SR51449: {'auction_closing_time': 1774714903.0, 'created_time': 1773772563.981637, 'last_price_update_time': 1774695753.350556}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR51449') HTTP/1.1" 204 0
2026-03-28 11:02:33 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 11:02:33 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.de] INFO: Scrape type for DT77440: 2
2026-03-28 11:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-28 11:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d27934-8b71-5f6b-948e-7576c2c7bac3, identifier: DT77440
2026-03-28 11:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-28 11:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-28 11:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440 to the API
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:49:19Z',
 'fuel_type': 'gas',
 'id': '67d27934-8b71-5f6b-948e-7576c2c7bac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT77440',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 40167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.0 TCe LPG Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2020}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.de] INFO: Saving data for DT77440: {'auction_closing_time': 1774716559.0, 'created_time': 1773426996.23229, 'last_price_update_time': 1774695753.805483}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT77440') HTTP/1.1" 204 0
2026-03-28 11:02:33 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 11:02:33 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-28 11:02:33 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.de] INFO: Scrape type for YU96411: 2
2026-03-28 11:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-28 11:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713588e3-a60b-556f-babb-e148ef288b2f with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713588e3-a60b-556f-babb-e148ef288b2f with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 713588e3-a60b-556f-babb-e148ef288b2f, identifier: YU96411
2026-03-28 11:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-28 11:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-28 11:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411 to the API
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:57:12Z',
 'fuel_type': 'petrol',
 'id': '713588e3-a60b-556f-babb-e148ef288b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU96411',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 111275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.de] INFO: Saving data for YU96411: {'auction_closing_time': 1774717032.0, 'created_time': 1773466227.040482, 'last_price_update_time': 1774695754.273772}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU96411') HTTP/1.1" 204 0
2026-03-28 11:02:34 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 11:02:34 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.de] INFO: Scrape type for AD28287: 2
2026-03-28 11:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-28 11:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-28 11:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f, identifier: AD28287
2026-03-28 11:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-28 11:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-28 11:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287 to the API
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:35:42Z',
 'fuel_type': 'petrol',
 'id': '7cbfd7db-0a6b-5148-bba3-21b5b7aec72f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD28287',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 104648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2015}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.de] INFO: Saving data for AD28287: {'auction_closing_time': 1774715742.0, 'created_time': 1773775671.866236, 'last_price_update_time': 1774695754.869516}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD28287') HTTP/1.1" 204 0
2026-03-28 11:02:34 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 11:02:34 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 11:02:34 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.de] INFO: Scrape type for HJ11294: 2
2026-03-28 11:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-28 11:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd7549f7-c69e-5a96-b13b-3aa8c51f7459, identifier: HJ11294
2026-03-28 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-28 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-28 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294 to the API
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:14Z',
 'fuel_type': 'diesel',
 'id': 'fd7549f7-c69e-5a96-b13b-3aa8c51f7459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ11294',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 146693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-11',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.de] INFO: Saving data for HJ11294: {'auction_closing_time': 1774716974.0, 'created_time': 1773302707.12766, 'last_price_update_time': 1774695755.313494}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ11294') HTTP/1.1" 204 0
2026-03-28 11:02:35 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 11:02:35 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 11:02:35 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.de] INFO: Scrape type for LU16486: 2
2026-03-28 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-28 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6174ccb-9071-50cd-92b6-53c1d9c50ad5, identifier: LU16486
2026-03-28 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-28 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-28 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486 to the API
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:06Z',
 'fuel_type': 'petrol',
 'id': 'd6174ccb-9071-50cd-92b6-53c1d9c50ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU16486',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 48528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.de] INFO: Saving data for LU16486: {'auction_closing_time': 1774713786.0, 'created_time': 1773741734.08073, 'last_price_update_time': 1774695755.761791}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU16486') HTTP/1.1" 204 0
2026-03-28 11:02:35 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:35 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 11:02:35 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.de] INFO: Scrape type for RU03073: 2
2026-03-28 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-28 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6026c26d-7adb-588f-b3d5-7c142d7882a6 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6026c26d-7adb-588f-b3d5-7c142d7882a6 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6026c26d-7adb-588f-b3d5-7c142d7882a6, identifier: RU03073
2026-03-28 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-28 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-28 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073 to the API
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:50:35Z',
 'fuel_type': 'petrol',
 'id': '6026c26d-7adb-588f-b3d5-7c142d7882a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU03073',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 112858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.de] INFO: Saving data for RU03073: {'auction_closing_time': 1774716635.0, 'created_time': 1774294810.515037, 'last_price_update_time': 1774695756.170039}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU03073') HTTP/1.1" 204 0
2026-03-28 11:02:36 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.de] INFO: Scrape type for MY70814: 2
2026-03-28 11:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-28 11:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcfc2730-553f-563d-88b9-6f24fed4ed19, identifier: MY70814
2026-03-28 11:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:36 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.de] INFO: Scrape type for JX81073: 2
2026-03-28 11:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-28 11:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71cc290a-52bb-576e-a722-9ce68fede8f9, identifier: JX81073
2026-03-28 11:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-28 11:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-28 11:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814 to the API
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:44Z',
 'fuel_type': 'diesel',
 'id': 'fcfc2730-553f-563d-88b9-6f24fed4ed19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY70814',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 273796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.de] INFO: Saving data for MY70814: {'auction_closing_time': 1774715204.0, 'created_time': 1773138690.716435, 'last_price_update_time': 1774695756.71937}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY70814') HTTP/1.1" 204 0
2026-03-28 11:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-28 11:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-28 11:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073 to the API
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:16Z',
 'fuel_type': 'diesel',
 'id': '71cc290a-52bb-576e-a722-9ce68fede8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX81073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 361254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-26',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Saving data for JX81073: {'auction_closing_time': 1774715116.0, 'created_time': 1774263171.889573, 'last_price_update_time': 1774695757.114962}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX81073') HTTP/1.1" 204 0
2026-03-28 11:02:37 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Scrape type for HG64056: 2
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0, identifier: HG64056
2026-03-28 11:02:37 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 11:02:37 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Scrape type for GD60404: 2
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66780655-43eb-5105-8a6f-d6ffb7db9def, identifier: GD60404
2026-03-28 11:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-28 11:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-28 11:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056 to the API
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'petrol',
 'id': '6f68b3c0-8911-50b9-b54f-b15889e2dfa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG64056',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 139940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Saving data for HG64056: {'auction_closing_time': 1774716244.0, 'created_time': 1773660014.792979, 'last_price_update_time': 1774695757.625811}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG64056') HTTP/1.1" 204 0
2026-03-28 11:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-28 11:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-28 11:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404 to the API
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:00Z',
 'fuel_type': 'petrol',
 'id': '66780655-43eb-5105-8a6f-d6ffb7db9def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD60404',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 87225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Saving data for GD60404: {'auction_closing_time': 1774714860.0, 'created_time': 1774290920.610145, 'last_price_update_time': 1774695757.95574}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD60404') HTTP/1.1" 204 0
2026-03-28 11:02:37 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 11:02:37 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.de] INFO: Scrape type for PK39186: 2
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4158606e-e4a8-564d-8d85-912f6be14261, identifier: PK39186
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.de] INFO: Scrape type for BF57036: 2
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d358263b-4490-5d1a-9022-1a5e059723da, identifier: BF57036
2026-03-28 11:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-28 11:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-28 11:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186 to the API
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:17:03Z',
 'fuel_type': 'petrol',
 'id': '4158606e-e4a8-564d-8d85-912f6be14261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK39186',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 70379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.de] INFO: Saving data for PK39186: {'auction_closing_time': 1774714623.0, 'created_time': 1774292004.598575, 'last_price_update_time': 1774695758.50808}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK39186') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-28 11:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-28 11:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036 to the API
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:51:33Z',
 'fuel_type': 'petrol',
 'id': 'd358263b-4490-5d1a-9022-1a5e059723da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF57036',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 78362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.de] INFO: Saving data for BF57036: {'auction_closing_time': 1774716693.0, 'created_time': 1773859593.650749, 'last_price_update_time': 1774695758.792246}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF57036') HTTP/1.1" 204 0
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.de] INFO: Scrape type for LR76257: 2
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2, identifier: LR76257
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 11:02:38 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.de] INFO: Scrape type for UH99848: 2
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6621d8f1-0d38-51de-aca4-fa266393b116, identifier: UH99848
2026-03-28 11:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-28 11:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-28 11:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257 to the API
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:42:14Z',
 'fuel_type': 'petrol',
 'id': 'dde93fbc-d47f-5bdc-912e-f44c64e7c2a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR76257',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 111778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-30',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.de] INFO: Saving data for LR76257: {'auction_closing_time': 1774716134.0, 'created_time': 1773306784.281635, 'last_price_update_time': 1774695759.300155}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR76257') HTTP/1.1" 204 0
2026-03-28 11:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-28 11:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-28 11:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848 to the API
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 328,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'hybrid',
 'id': '6621d8f1-0d38-51de-aca4-fa266393b116',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH99848',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 77335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-01',
 'seller_name': None,
 'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Prime-Line AWD',
 'transmission': 'automatic',
 'trim': 'Prime-Line AWD',
 'year': 2023}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.de] INFO: Saving data for UH99848: {'auction_closing_time': 1774716244.0, 'created_time': 1773223968.395854, 'last_price_update_time': 1774695759.69877}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH99848') HTTP/1.1" 204 0
2026-03-28 11:02:39 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 11:02:39 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.de] INFO: Scrape type for YE81869: 2
2026-03-28 11:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-28 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8, identifier: YE81869
2026-03-28 11:02:39 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.de] INFO: Scrape type for XF55006: 2
2026-03-28 11:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-28 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca83185e-10e0-55c1-aafe-0031eff06766, identifier: XF55006
2026-03-28 11:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-28 11:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-28 11:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869 to the API
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:47Z',
 'fuel_type': 'petrol',
 'id': 'f6fb1fd1-f457-5987-ab8c-66c45c13f8a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE81869',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 227204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [auto1.de] INFO: Saving data for YE81869: {'auction_closing_time': 1774714307.0, 'created_time': 1773469073.781054, 'last_price_update_time': 1774695760.249895}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE81869') HTTP/1.1" 204 0
2026-03-28 11:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-28 11:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-28 11:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006 to the API
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:51:11Z',
 'fuel_type': 'petrol',
 'id': 'ca83185e-10e0-55c1-aafe-0031eff06766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF55006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 67714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [auto1.de] INFO: Saving data for XF55006: {'auction_closing_time': 1774716671.0, 'created_time': 1773133734.026963, 'last_price_update_time': 1774695760.597803}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF55006') HTTP/1.1" 204 0
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [auto1.de] INFO: Scrape type for PF97511: 2
2026-03-28 11:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-28 11:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-28 11:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44034d65-de7f-5afa-806b-4c568deb5a2b, identifier: PF97511
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 11:02:40 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 11:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-28 11:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-28 11:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511 to the API
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:30Z',
 'fuel_type': 'diesel',
 'id': '44034d65-de7f-5afa-806b-4c568deb5a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF97511',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 376988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-20',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Saving data for PF97511: {'auction_closing_time': 1774715370.0, 'created_time': 1773467119.490981, 'last_price_update_time': 1774695761.062619}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF97511') HTTP/1.1" 204 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for HX00306: 2
2026-03-28 11:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-28 11:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e19cd1-bafb-5783-877a-afdf277ea06e, identifier: HX00306
2026-03-28 11:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-28 11:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-28 11:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306 to the API
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:45:58Z',
 'fuel_type': 'diesel',
 'id': '45e19cd1-bafb-5783-877a-afdf277ea06e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00306',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 355675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-21',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Saving data for HX00306: {'auction_closing_time': 1774716358.0, 'created_time': 1773687000.774716, 'last_price_update_time': 1774695761.566336}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00306') HTTP/1.1" 204 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for XG94093: 2
2026-03-28 11:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-28 11:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcbe0b8-d993-516d-b47a-f969a069e018, identifier: XG94093
2026-03-28 11:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-28 11:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-28 11:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093 to the API
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:24:00Z',
 'fuel_type': 'petrol',
 'id': 'afcbe0b8-d993-516d-b47a-f969a069e018',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG94093',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 84378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-08',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2020}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Saving data for XG94093: {'auction_closing_time': 1774715040.0, 'created_time': 1773830935.366758, 'last_price_update_time': 1774695762.136289}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG94093') HTTP/1.1" 204 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for XK87583: 2
2026-03-28 11:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-28 11:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d, identifier: XK87583
2026-03-28 11:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-28 11:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-28 11:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583 to the API
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:45:30Z',
 'fuel_type': 'diesel',
 'id': 'ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK87583',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 209117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-13',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Saving data for XK87583: {'auction_closing_time': 1774716330.0, 'created_time': 1773775519.798467, 'last_price_update_time': 1774695762.762227}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK87583') HTTP/1.1" 204 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for PU26229: 2
2026-03-28 11:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-28 11:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7b8a3b0-afa1-5551-9113-b3158158a271, identifier: PU26229
2026-03-28 11:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-28 11:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-28 11:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229 to the API
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:00:43Z',
 'fuel_type': 'petrol',
 'id': 'f7b8a3b0-afa1-5551-9113-b3158158a271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU26229',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 156661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
 'transmission': 'automatic',
 'trim': 'quattro Performance',
 'year': 2016}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.de] INFO: Saving data for PU26229: {'auction_closing_time': 1774713643.0, 'created_time': 1774292341.265369, 'last_price_update_time': 1774695763.261364}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU26229') HTTP/1.1" 204 0
2026-03-28 11:02:43 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 11:02:43 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 11:02:43 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.de] INFO: Scrape type for VX14818: 2
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1, identifier: VX14818
2026-03-28 11:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-28 11:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-28 11:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818 to the API
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'petrol',
 'id': '0a87f512-0a7f-5131-9ee0-e5d1de9e35c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14818',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 115326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.de] INFO: Saving data for VX14818: {'auction_closing_time': 1774714739.0, 'created_time': 1773775608.932776, 'last_price_update_time': 1774695763.759919}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14818') HTTP/1.1" 204 0
2026-03-28 11:02:43 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.de] INFO: Scrape type for LM98964: 2
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9b852c-e3fa-510a-8343-cfaba76a51c7, identifier: LM98964
2026-03-28 11:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-28 11:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-28 11:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964 to the API
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:07Z',
 'fuel_type': 'petrol',
 'id': '9a9b852c-e3fa-510a-8343-cfaba76a51c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM98964',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 81450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-01',
 'seller_name': None,
 'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2014}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Saving data for LM98964: {'auction_closing_time': 1774716067.0, 'created_time': 1773776027.311036, 'last_price_update_time': 1774695764.325476}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM98964') HTTP/1.1" 204 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for ZR39643: 2
2026-03-28 11:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-28 11:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf69fe3-72fa-518b-85bc-30f2c413c9ff, identifier: ZR39643
2026-03-28 11:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-28 11:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-28 11:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643 to the API
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:40Z',
 'fuel_type': 'diesel',
 'id': 'cbf69fe3-72fa-518b-85bc-30f2c413c9ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39643',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 310704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Roncalli',
 'transmission': 'manual',
 'trim': 'Maxi Roncalli',
 'year': 2012}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Saving data for ZR39643: {'auction_closing_time': 1774716100.0, 'created_time': 1773859552.325996, 'last_price_update_time': 1774695764.83057}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39643') HTTP/1.1" 204 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for LS36397: 2
2026-03-28 11:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-28 11:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a82215-c99f-5e78-b533-ee6f3f56b44c, identifier: LS36397
2026-03-28 11:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-28 11:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-28 11:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397 to the API
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:13Z',
 'fuel_type': 'diesel',
 'id': '25a82215-c99f-5e78-b533-ee6f3f56b44c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS36397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 116947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2015}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.de] INFO: Saving data for LS36397: {'auction_closing_time': 1774715773.0, 'created_time': 1773399028.614564, 'last_price_update_time': 1774695765.303424}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS36397') HTTP/1.1" 204 0
2026-03-28 11:02:45 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 11:02:45 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.de] INFO: Scrape type for DD70281: 2
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52e7d1b2-4ac5-573e-a457-f4cba539924f, identifier: DD70281
2026-03-28 11:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-28 11:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-28 11:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281 to the API
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:29:25Z',
 'fuel_type': 'diesel',
 'id': '52e7d1b2-4ac5-573e-a457-f4cba539924f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD70281',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 216354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.de] INFO: Saving data for DD70281: {'auction_closing_time': 1774715365.0, 'created_time': 1773662296.665719, 'last_price_update_time': 1774695765.797443}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD70281') HTTP/1.1" 204 0
2026-03-28 11:02:45 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 11:02:45 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 11:02:45 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.de] INFO: Scrape type for CM33145: 2
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0db03aed-3932-5b8c-9129-44c0083c47f9, identifier: CM33145
2026-03-28 11:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-28 11:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-28 11:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145 to the API
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:03:45Z',
 'fuel_type': 'petrol',
 'id': '0db03aed-3932-5b8c-9129-44c0083c47f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM33145',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 124763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.de] INFO: Saving data for CM33145: {'auction_closing_time': 1774713825.0, 'created_time': 1773859966.916989, 'last_price_update_time': 1774695766.32534}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM33145') HTTP/1.1" 204 0
2026-03-28 11:02:46 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.de] INFO: Scrape type for KR04535: 2
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-28 11:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5189051-2f00-574e-8578-3a2ccbf9f416, identifier: KR04535
2026-03-28 11:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-28 11:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-28 11:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535 to the API
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:49:06Z',
 'fuel_type': 'petrol',
 'id': 'b5189051-2f00-574e-8578-3a2ccbf9f416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR04535',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 174737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-05',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.de] INFO: Saving data for KR04535: {'auction_closing_time': 1774716546.0, 'created_time': 1773427325.088636, 'last_price_update_time': 1774695766.878751}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR04535') HTTP/1.1" 204 0
2026-03-28 11:02:46 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 11:02:46 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.de] INFO: Scrape type for PE91450: 2
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adc36cff-999e-5178-a979-7747d1f01eca, identifier: PE91450
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-28 11:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-28 11:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450 to the API
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:29:23Z',
 'fuel_type': 'petrol',
 'id': 'adc36cff-999e-5178-a979-7747d1f01eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE91450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Edition 2020 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.de] INFO: Saving data for PE91450: {'auction_closing_time': 1774715363.0, 'created_time': 1774294889.730642, 'last_price_update_time': 1774695767.335594}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE91450') HTTP/1.1" 204 0
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 11:02:47 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9700 | hits on page: 40
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.de] INFO: Scrape type for BV55429: 2
2026-03-28 11:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-28 11:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9f3241-f4e9-5dc0-93f2-0a175476e266, identifier: BV55429
2026-03-28 11:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 11:02:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-28 11:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429 to the API
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:43Z',
 'fuel_type': 'diesel',
 'id': '0f9f3241-f4e9-5dc0-93f2-0a175476e266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV55429',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 258012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend',
 'transmission': 'automatic',
 'trim': 'kompakt Trend',
 'year': 2010}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.de] INFO: Saving data for BV55429: {'auction_closing_time': 1774716883.0, 'created_time': 1773466624.841306, 'last_price_update_time': 1774695767.939849}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV55429') HTTP/1.1" 204 0
2026-03-28 11:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:47 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.de] INFO: Scrape type for HT48359: 2
2026-03-28 11:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-28 11:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67321d13-024e-5a3f-b165-2e95b5d92cd0, identifier: HT48359
2026-03-28 11:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-28 11:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-28 11:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359 to the API
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:12:57Z',
 'fuel_type': 'petrol',
 'id': '67321d13-024e-5a3f-b165-2e95b5d92cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT48359',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 12161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2024}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.de] INFO: Saving data for HT48359: {'auction_closing_time': 1774714377.0, 'created_time': 1773302749.523, 'last_price_update_time': 1774695768.422108}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT48359') HTTP/1.1" 204 0
2026-03-28 11:02:48 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 11:02:48 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 11:02:48 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.de] INFO: Scrape type for HS66521: 2
2026-03-28 11:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-28 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 902f27fe-dceb-59f4-822e-05fabfe636e1, identifier: HS66521
2026-03-28 11:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-28 11:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-28 11:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521 to the API
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:00:48Z',
 'fuel_type': 'petrol',
 'id': '902f27fe-dceb-59f4-822e-05fabfe636e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS66521',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 52789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.de] INFO: Saving data for HS66521: {'auction_closing_time': 1774713648.0, 'created_time': 1773688212.465495, 'last_price_update_time': 1774695768.974942}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS66521') HTTP/1.1" 204 0
2026-03-28 11:02:48 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.de] INFO: Scrape type for TF25150: 2
2026-03-28 11:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-28 11:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a6f981-b227-5aec-a4e6-cd4896f44197 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a6f981-b227-5aec-a4e6-cd4896f44197 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8a6f981-b227-5aec-a4e6-cd4896f44197, identifier: TF25150
2026-03-28 11:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-28 11:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-28 11:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150 to the API
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 401,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'petrol',
 'id': 'a8a6f981-b227-5aec-a4e6-cd4896f44197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF25150',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Ram 1500',
 'odometer': 265765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-14',
 'seller_name': None,
 'title': 'Dodge Ram 1500 5.7 V8 2X4',
 'transmission': 'automatic',
 'trim': '2X4',
 'year': 2018}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.de] INFO: Saving data for TF25150: {'auction_closing_time': 1774714267.0, 'created_time': 1773223487.413305, 'last_price_update_time': 1774695769.443619}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF25150') HTTP/1.1" 204 0
2026-03-28 11:02:49 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 11:02:49 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.de] INFO: Scrape type for YR07443: 2
2026-03-28 11:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-28 11:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dc696c5-580f-5784-974b-bc532cf68bd7, identifier: YR07443
2026-03-28 11:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-28 11:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-28 11:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443 to the API
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:13:38Z',
 'fuel_type': 'diesel',
 'id': '5dc696c5-580f-5784-974b-bc532cf68bd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR07443',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 111280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-20',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.de] INFO: Saving data for YR07443: {'auction_closing_time': 1774714418.0, 'created_time': 1773427045.549917, 'last_price_update_time': 1774695770.436711}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR07443') HTTP/1.1" 204 0
2026-03-28 11:02:50 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 11:02:50 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.de] INFO: Scrape type for EJ40099: 2
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-28 11:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377, identifier: EJ40099
2026-03-28 11:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-28 11:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-28 11:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099 to the API
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:57:25Z',
 'fuel_type': 'petrol',
 'id': '8d6958c0-2d41-5ef8-9680-ce1b28f6a377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ40099',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 113390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-01',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2012}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.de] INFO: Saving data for EJ40099: {'auction_closing_time': 1774717045.0, 'created_time': 1773469063.801623, 'last_price_update_time': 1774695770.916}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ40099') HTTP/1.1" 204 0
2026-03-28 11:02:50 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.de] INFO: Scrape type for KS23837: 2
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9702932a-50a8-54af-9bce-3a4249a89b0b, identifier: KS23837
2026-03-28 11:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-28 11:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-28 11:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837 to the API
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:54:26Z',
 'fuel_type': 'diesel',
 'id': '9702932a-50a8-54af-9bce-3a4249a89b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS23837',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 87729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2020}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.de] INFO: Saving data for KS23837: {'auction_closing_time': 1774716866.0, 'created_time': 1772540493.153206, 'last_price_update_time': 1774695771.445826}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS23837') HTTP/1.1" 204 0
2026-03-28 11:02:51 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.de] INFO: Scrape type for NY67891: 2
2026-03-28 11:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-28 11:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6415df-73d6-5386-b38b-37f5ce6717a3, identifier: NY67891
2026-03-28 11:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-28 11:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-28 11:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891 to the API
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:03Z',
 'fuel_type': 'petrol',
 'id': '8b6415df-73d6-5386-b38b-37f5ce6717a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY67891',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 94062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.de] INFO: Saving data for NY67891: {'auction_closing_time': 1774715343.0, 'created_time': 1773429153.567507, 'last_price_update_time': 1774695771.895323}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY67891') HTTP/1.1" 204 0
2026-03-28 11:02:51 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 11:02:51 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.de] INFO: Scrape type for FY25163: 2
2026-03-28 11:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-28 11:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99d96466-3930-51a6-b1be-0dc52f8c6537, identifier: FY25163
2026-03-28 11:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-28 11:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-28 11:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163 to the API
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:35:39Z',
 'fuel_type': 'petrol',
 'id': '99d96466-3930-51a6-b1be-0dc52f8c6537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY25163',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 274078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2004}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.de] INFO: Saving data for FY25163: {'auction_closing_time': 1774715739.0, 'created_time': 1774265056.555747, 'last_price_update_time': 1774695772.365553}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY25163') HTTP/1.1" 204 0
2026-03-28 11:02:52 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 11:02:52 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 11:02:52 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.de] INFO: Scrape type for WD77905: 2
2026-03-28 11:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-28 11:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07d51b98-8420-5bdb-879c-0e5f42d78048, identifier: WD77905
2026-03-28 11:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-28 11:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-28 11:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905 to the API
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:40:10Z',
 'fuel_type': 'petrol',
 'id': '07d51b98-8420-5bdb-879c-0e5f42d78048',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD77905',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 111574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1991-11-18',
 'seller_name': None,
 'title': 'Porsche 911 964 Carrera 4',
 'transmission': 'manual',
 'trim': 'Carrera 4',
 'year': 1991}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.de] INFO: Saving data for WD77905: {'auction_closing_time': 1774716010.0, 'created_time': 1774377395.585769, 'last_price_update_time': 1774695772.920292}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD77905') HTTP/1.1" 204 0
2026-03-28 11:02:52 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.de] INFO: Scrape type for CY56514: 2
2026-03-28 11:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-28 11:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e, identifier: CY56514
2026-03-28 11:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-28 11:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-28 11:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514 to the API
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:37:56Z',
 'fuel_type': 'diesel',
 'id': '57e52fdd-5b2a-59c8-abec-7ab9df597f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY56514',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 221238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.de] INFO: Saving data for CY56514: {'auction_closing_time': 1774715876.0, 'created_time': 1773776238.820337, 'last_price_update_time': 1774695773.455478}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY56514') HTTP/1.1" 204 0
2026-03-28 11:02:53 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.de] INFO: Scrape type for ZY38898: 2
2026-03-28 11:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-28 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55a13684-c1a1-5d35-91ad-820ae00d4766, identifier: ZY38898
2026-03-28 11:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-28 11:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-28 11:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898 to the API
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:11:17Z',
 'fuel_type': 'diesel',
 'id': '55a13684-c1a1-5d35-91ad-820ae00d4766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY38898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 119365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-07',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.de] INFO: Saving data for ZY38898: {'auction_closing_time': 1774714277.0, 'created_time': 1774294319.567424, 'last_price_update_time': 1774695773.907234}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY38898') HTTP/1.1" 204 0
2026-03-28 11:02:53 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 11:02:53 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.de] INFO: Scrape type for NX41680: 2
2026-03-28 11:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-28 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 139a3cd3-d0c5-5bf5-969a-41347fc2d737, identifier: NX41680
2026-03-28 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-28 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-28 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680 to the API
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:12:03Z',
 'fuel_type': 'diesel',
 'id': '139a3cd3-d0c5-5bf5-969a-41347fc2d737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX41680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 286058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.de] INFO: Saving data for NX41680: {'auction_closing_time': 1774714323.0, 'created_time': 1774293875.220949, 'last_price_update_time': 1774695774.336283}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX41680') HTTP/1.1" 204 0
2026-03-28 11:02:54 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9700 | hits on page: 40
2026-03-28 11:02:54 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.de] INFO: Scrape type for AH37368: 2
2026-03-28 11:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-28 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8879a54d-d2db-59b0-9d1a-a931b7781478, identifier: AH37368
2026-03-28 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-28 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-28 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368 to the API
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:22:19Z',
 'fuel_type': 'diesel',
 'id': '8879a54d-d2db-59b0-9d1a-a931b7781478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH37368',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 203164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-20',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2014}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.de] INFO: Saving data for AH37368: {'auction_closing_time': 1774714939.0, 'created_time': 1773859368.864012, 'last_price_update_time': 1774695774.817742}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH37368') HTTP/1.1" 204 0
2026-03-28 11:02:54 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.de] INFO: Scrape type for RZ86023: 2
2026-03-28 11:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-28 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aa066d-4166-54bc-8173-c7c4b71ccf2f, identifier: RZ86023
2026-03-28 11:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:54 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-28 11:02:54 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 11:02:54 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.de] INFO: Scrape type for GM59511: 2
2026-03-28 11:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-28 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06, identifier: GM59511
2026-03-28 11:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-28 11:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-28 11:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023 to the API
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:12:52Z',
 'fuel_type': 'petrol',
 'id': 'd3aa066d-4166-54bc-8173-c7c4b71ccf2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ86023',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 152454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-14',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.de] INFO: Saving data for RZ86023: {'auction_closing_time': 1774714372.0, 'created_time': 1774291993.583421, 'last_price_update_time': 1774695775.415487}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ86023') HTTP/1.1" 204 0
2026-03-28 11:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-28 11:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-28 11:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511 to the API
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:53Z',
 'fuel_type': 'petrol',
 'id': '1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59511',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 202277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-25',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2018}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.de] INFO: Saving data for GM59511: {'auction_closing_time': 1774714913.0, 'created_time': 1773772236.151639, 'last_price_update_time': 1774695775.879337}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM59511') HTTP/1.1" 204 0
2026-03-28 11:02:55 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.de] INFO: Scrape type for ML83071: 2
2026-03-28 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-28 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf1464de-ec0f-5df8-9637-527ced3807d1, identifier: ML83071
2026-03-28 11:02:56 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.de] INFO: Scrape type for HF47887: 2
2026-03-28 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-28 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38a9b04-c555-594f-951a-43675a0a24d6, identifier: HF47887
2026-03-28 11:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-28 11:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-28 11:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071 to the API
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:05:39Z',
 'fuel_type': 'diesel',
 'id': 'bf1464de-ec0f-5df8-9637-527ced3807d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML83071',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 240215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-29',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2010}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.de] INFO: Saving data for ML83071: {'auction_closing_time': 1774713939.0, 'created_time': 1773811836.820344, 'last_price_update_time': 1774695776.486865}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML83071') HTTP/1.1" 204 0
2026-03-28 11:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-28 11:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-28 11:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887 to the API
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:23:41Z',
 'fuel_type': 'petrol',
 'id': 'a38a9b04-c555-594f-951a-43675a0a24d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47887',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 113018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-31',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.de] INFO: Saving data for HF47887: {'auction_closing_time': 1774715021.0, 'created_time': 1773344898.262217, 'last_price_update_time': 1774695776.831323}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47887') HTTP/1.1" 204 0
2026-03-28 11:02:56 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 11:02:56 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.de] INFO: Scrape type for DF17432: 2
2026-03-28 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-28 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fba982-c75b-5b0d-bb14-56f7808719b3, identifier: DF17432
2026-03-28 11:02:56 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.de] INFO: Scrape type for WP35313: 2
2026-03-28 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-28 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2050306c-95eb-53e7-84ef-119a1cccb941 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2050306c-95eb-53e7-84ef-119a1cccb941 with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2050306c-95eb-53e7-84ef-119a1cccb941, identifier: WP35313
2026-03-28 11:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-28 11:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-28 11:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432 to the API
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:57:11Z',
 'fuel_type': 'petrol',
 'id': '15fba982-c75b-5b0d-bb14-56f7808719b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF17432',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 71020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.de] INFO: Saving data for DF17432: {'auction_closing_time': 1774717031.0, 'created_time': 1773138727.980088, 'last_price_update_time': 1774695777.441598}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF17432') HTTP/1.1" 204 0
2026-03-28 11:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-28 11:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-28 11:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313 to the API
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:09:56Z',
 'fuel_type': 'petrol',
 'id': '2050306c-95eb-53e7-84ef-119a1cccb941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP35313',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 188366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Fiat Qubo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2008}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.de] INFO: Saving data for WP35313: {'auction_closing_time': 1774714196.0, 'created_time': 1774607892.983124, 'last_price_update_time': 1774695777.840848}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP35313') HTTP/1.1" 204 0
2026-03-28 11:02:57 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.de] INFO: Scrape type for NB05774: 2
2026-03-28 11:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-28 11:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd943df-a583-5214-85c6-7f9588fb9e2d, identifier: NB05774
2026-03-28 11:02:57 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.de] INFO: Scrape type for AU29418: 2
2026-03-28 11:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-28 11:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd, identifier: AU29418
2026-03-28 11:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-28 11:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-28 11:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774 to the API
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'diesel',
 'id': 'efd943df-a583-5214-85c6-7f9588fb9e2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB05774',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 90166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI GTD',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2022}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.de] INFO: Saving data for NB05774: {'auction_closing_time': 1774713711.0, 'created_time': 1773387069.761915, 'last_price_update_time': 1774695778.383616}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB05774') HTTP/1.1" 204 0
2026-03-28 11:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-28 11:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-28 11:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418 to the API
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 281,
 'expiration_date': '2026-03-28T16:27:30Z',
 'fuel_type': 'petrol',
 'id': '2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU29418',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 18673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2023}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.de] INFO: Saving data for AU29418: {'auction_closing_time': 1774715250.0, 'created_time': 1774293951.753626, 'last_price_update_time': 1774695778.680099}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU29418') HTTP/1.1" 204 0
2026-03-28 11:02:58 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-28 11:02:58 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 11:02:58 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.de] INFO: Scrape type for FD55088: 2
2026-03-28 11:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-28 11:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cae73e79-fd7c-582c-b87e-cd4fdbb01de2, identifier: FD55088
2026-03-28 11:02:58 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 11:02:58 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.de] INFO: Scrape type for CV64840: 2
2026-03-28 11:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-28 11:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59405564-e0ad-51a3-9882-d7724f423a48, identifier: CV64840
2026-03-28 11:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-28 11:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-28 11:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088 to the API
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:27:37Z',
 'fuel_type': 'petrol',
 'id': 'cae73e79-fd7c-582c-b87e-cd4fdbb01de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD55088',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 238568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2004}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.de] INFO: Saving data for FD55088: {'auction_closing_time': 1774715257.0, 'created_time': 1774349944.992767, 'last_price_update_time': 1774695779.287656}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD55088') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-28 11:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-28 11:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840 to the API
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:16:09Z',
 'fuel_type': 'petrol',
 'id': '59405564-e0ad-51a3-9882-d7724f423a48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV64840',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 24462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.de] INFO: Saving data for CV64840: {'auction_closing_time': 1774714569.0, 'created_time': 1774293854.856412, 'last_price_update_time': 1774695779.711888}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV64840') HTTP/1.1" 204 0
2026-03-28 11:02:59 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.de] INFO: Scrape type for YN10477: 2
2026-03-28 11:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-28 11:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 767874dd-8854-5495-b26e-2ed022d09474, identifier: YN10477
2026-03-28 11:02:59 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 11:02:59 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 11:02:59 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.de] INFO: Scrape type for MV92547: 2
2026-03-28 11:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-28 11:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f, identifier: MV92547
2026-03-28 11:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-28 11:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-28 11:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477 to the API
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'diesel',
 'id': '767874dd-8854-5495-b26e-2ed022d09474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN10477',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 202455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [auto1.de] INFO: Saving data for YN10477: {'auction_closing_time': 1774716544.0, 'created_time': 1774262580.263548, 'last_price_update_time': 1774695780.376537}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN10477') HTTP/1.1" 204 0
2026-03-28 11:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-28 11:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-28 11:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547 to the API
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:12:25Z',
 'fuel_type': 'petrol',
 'id': 'dd45a1c7-0a05-58f7-af6a-c15e3d223f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV92547',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 108582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-09',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [auto1.de] INFO: Saving data for MV92547: {'auction_closing_time': 1774714345.0, 'created_time': 1773304589.394061, 'last_price_update_time': 1774695780.710113}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV92547') HTTP/1.1" 204 0
2026-03-28 11:03:00 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [auto1.de] INFO: Scrape type for BS14183: 2
2026-03-28 11:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-28 11:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e, identifier: BS14183
2026-03-28 11:03:00 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 11:03:00 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 11:03:00 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [auto1.de] INFO: Scrape type for ND18169: 2
2026-03-28 11:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-28 11:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65d9dc76-4491-5308-9b75-88a0aceea15e, identifier: ND18169
2026-03-28 11:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-28 11:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-28 11:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183 to the API
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'diesel',
 'id': 'ccde1fa7-8f30-5cff-ac77-cf11bf9f344e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14183',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 318606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Saving data for BS14183: {'auction_closing_time': 1774714694.0, 'created_time': 1773657878.991557, 'last_price_update_time': 1774695781.313662}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS14183') HTTP/1.1" 204 0
2026-03-28 11:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-28 11:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-28 11:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169 to the API
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:37Z',
 'fuel_type': 'petrol',
 'id': '65d9dc76-4491-5308-9b75-88a0aceea15e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND18169',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 134901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Saving data for ND18169: {'auction_closing_time': 1774714417.0, 'created_time': 1773732648.390875, 'last_price_update_time': 1774695781.606093}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND18169') HTTP/1.1" 204 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for KJ55573: 2
2026-03-28 11:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-28 11:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0, identifier: KJ55573
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for UE28952: 2
2026-03-28 11:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-28 11:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597, identifier: UE28952
2026-03-28 11:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-28 11:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-28 11:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573 to the API
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:45:30Z',
 'fuel_type': 'diesel',
 'id': 'eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ55573',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 180448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Saving data for KJ55573: {'auction_closing_time': 1774716330.0, 'created_time': 1774293423.03468, 'last_price_update_time': 1774695782.164139}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ55573') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-28 11:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-28 11:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952 to the API
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:05:07Z',
 'fuel_type': 'diesel',
 'id': 'ed2cc29a-6784-59ea-a8d3-2e2ef23b8597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE28952',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 102150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Saving data for UE28952: {'auction_closing_time': 1774713907.0, 'created_time': 1773687295.060854, 'last_price_update_time': 1774695782.580659}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE28952') HTTP/1.1" 204 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for UN13511: 2
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-28 11:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37544f20-f4f9-5ba6-a37e-5c299210d676, identifier: UN13511
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 11:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-28 11:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-28 11:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511 to the API
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:34:33Z',
 'fuel_type': 'petrol',
 'id': '37544f20-f4f9-5ba6-a37e-5c299210d676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN13511',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 17692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-14',
 'seller_name': None,
 'title': 'Ford Focus 2.0 Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2009}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Saving data for UN13511: {'auction_closing_time': 1774715673.0, 'created_time': 1772546597.414282, 'last_price_update_time': 1774695783.015629}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN13511') HTTP/1.1" 204 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for SF39323: 2
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 516bf52b-7d1a-5824-8a78-514fd82ab9be, identifier: SF39323
2026-03-28 11:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-28 11:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-28 11:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323 to the API
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:40:23Z',
 'fuel_type': 'diesel',
 'id': '516bf52b-7d1a-5824-8a78-514fd82ab9be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF39323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 214198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2007}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Saving data for SF39323: {'auction_closing_time': 1774716023.0, 'created_time': 1773341507.645434, 'last_price_update_time': 1774695783.45593}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF39323') HTTP/1.1" 204 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for JV68921: 2
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 578483f7-106b-5d5c-aa13-65f7a53dd0d4, identifier: JV68921
2026-03-28 11:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-28 11:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-28 11:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921 to the API
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-28T16:50:36Z',
 'fuel_type': 'hybrid',
 'id': '578483f7-106b-5d5c-aa13-65f7a53dd0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68921',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 44585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-01',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus 4WD',
 'transmission': 'automatic',
 'trim': 'Plus 4WD',
 'year': 2021}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Saving data for JV68921: {'auction_closing_time': 1774716636.0, 'created_time': 1774293915.315679, 'last_price_update_time': 1774695783.970984}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68921') HTTP/1.1" 204 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for TU97792: 2
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf, identifier: TU97792
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-28 11:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792 to the API
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-28T16:32:28Z',
 'fuel_type': 'diesel',
 'id': '720c9c0a-b91f-5e92-bc08-7f234d3e9ddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU97792',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 76073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Saving data for TU97792: {'auction_closing_time': 1774715548.0, 'created_time': 1774293193.95069, 'last_price_update_time': 1774695784.464002}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU97792') HTTP/1.1" 204 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for VG31593: 2
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb09a726-8673-56d7-901b-435312ad1eb7, identifier: VG31593
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-28 11:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593 to the API
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:51Z',
 'fuel_type': 'petrol',
 'id': 'bb09a726-8673-56d7-901b-435312ad1eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG31593',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 62671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Turbo Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.de] INFO: Saving data for VG31593: {'auction_closing_time': 1774716051.0, 'created_time': 1773400548.816226, 'last_price_update_time': 1774695785.057541}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG31593') HTTP/1.1" 204 0
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.de] INFO: Scrape type for DS71504: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a16104c-a989-59e4-a076-4ccb828c94a3, identifier: DS71504
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504 to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:44:35Z',
 'fuel_type': 'petrol',
 'id': '5a16104c-a989-59e4-a076-4ccb828c94a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS71504',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 318722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-30',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 3.8 V6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.de] INFO: Saving data for DS71504: {'auction_closing_time': 1774716275.0, 'created_time': 1773774573.224593, 'last_price_update_time': 1774695785.495785}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS71504') HTTP/1.1" 204 0
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.de] INFO: Scrape type for ZE41577: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3, identifier: ZE41577
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577 to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:51:56Z',
 'fuel_type': 'diesel',
 'id': '28e0b63b-a1f1-5434-b83d-e69deadc7fa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE41577',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 56337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium',
 'year': 2022}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.de] INFO: Saving data for ZE41577: {'auction_closing_time': 1774716716.0, 'created_time': 1773513911.847413, 'last_price_update_time': 1774695785.927839}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE41577') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for DM09688: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96, identifier: DM09688
2026-03-28 11:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-28 11:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-28 11:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688 to the API
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:47:48Z',
 'fuel_type': 'hybrid',
 'id': '2bedea8c-86ef-55b4-b91a-2b03e16d7a96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM09688',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 83000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Saving data for DM09688: {'auction_closing_time': 1774716468.0, 'created_time': 1773304748.988045, 'last_price_update_time': 1774695786.509578}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM09688') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for EJ65167: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eae9671e-9421-543e-b9fc-2939da586128, identifier: EJ65167
2026-03-28 11:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-28 11:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-28 11:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167 to the API
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:58:05Z',
 'fuel_type': 'petrol',
 'id': 'eae9671e-9421-543e-b9fc-2939da586128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ65167',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 101389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Saving data for EJ65167: {'auction_closing_time': 1774717085.0, 'created_time': 1774330258.749606, 'last_price_update_time': 1774695786.969443}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ65167') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for FC63717: 2
2026-03-28 11:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-28 11:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202cc82-8783-587b-94f3-5bf44f83d80a, identifier: FC63717
2026-03-28 11:03:07 [scrapy.extensions.logstats] INFO: Crawled 417 pages (at 6 pages/min), scraped 518 items (at 125 items/min)
2026-03-28 11:03:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-28 11:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717 to the API
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:59:35Z',
 'fuel_type': 'petrol',
 'id': '4202cc82-8783-587b-94f3-5bf44f83d80a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC63717',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 193879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2007}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Saving data for FC63717: {'auction_closing_time': 1774717175.0, 'created_time': 1773400373.320799, 'last_price_update_time': 1774695787.432167}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC63717') HTTP/1.1" 204 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:27 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:27 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 11:03:27 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.de] INFO: Scrape type for GT54447: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b, identifier: GT54447
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-28 11:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447 to the API
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:19Z',
 'fuel_type': 'petrol',
 'id': '55f72f66-aea8-5595-8cbf-0e9fd7ed591b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 50856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.de] INFO: Saving data for GT54447: {'auction_closing_time': 1774716259.0, 'created_time': 1772726386.234366, 'last_price_update_time': 1774695808.060982}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT54447') HTTP/1.1" 204 0
2026-03-28 11:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:28 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.de] INFO: Scrape type for UC48235: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f844a996-7748-5fb5-834a-0e0b804d35ea, identifier: UC48235
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-28 11:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235 to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'hybrid',
 'id': 'f844a996-7748-5fb5-834a-0e0b804d35ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC48235',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 78881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-07',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T6 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.de] INFO: Saving data for UC48235: {'auction_closing_time': 1774713913.0, 'created_time': 1773741152.924581, 'last_price_update_time': 1774695808.505121}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC48235') HTTP/1.1" 204 0
2026-03-28 11:03:28 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 11:03:28 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 11:03:28 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 11:03:28 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.de] INFO: Scrape type for PD80009: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 857ec4fb-2a56-5289-85b9-c2dd0013eb20, identifier: PD80009
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-28 11:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009 to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:57:42Z',
 'fuel_type': 'diesel',
 'id': '857ec4fb-2a56-5289-85b9-c2dd0013eb20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD80009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 252762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2013}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.de] INFO: Saving data for PD80009: {'auction_closing_time': 1774717062.0, 'created_time': 1774294710.373887, 'last_price_update_time': 1774695808.958323}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD80009') HTTP/1.1" 204 0
2026-03-28 11:03:29 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.de] INFO: Scrape type for PZ11168: 2
2026-03-28 11:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-28 11:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91493f5-bed5-598c-b340-804c782350b3, identifier: PZ11168
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-28 11:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168 to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:35:04Z',
 'fuel_type': 'petrol',
 'id': 'e91493f5-bed5-598c-b340-804c782350b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ11168',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 182524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.de] INFO: Saving data for PZ11168: {'auction_closing_time': 1774715704.0, 'created_time': 1773466755.781098, 'last_price_update_time': 1774695809.553975}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ11168') HTTP/1.1" 204 0
2026-03-28 11:03:29 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.de] INFO: Scrape type for LB22457: 2
2026-03-28 11:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-28 11:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8896f62-3846-5f03-86a5-8c9a4ec8e05d, identifier: LB22457
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-28 11:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457 to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:53:04Z',
 'fuel_type': 'diesel',
 'id': 'd8896f62-3846-5f03-86a5-8c9a4ec8e05d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB22457',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 175198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Nakama Intense AWD',
 'transmission': 'automatic',
 'trim': 'Nakama Intense AWD',
 'year': 2016}
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [auto1.de] INFO: Saving data for LB22457: {'auction_closing_time': 1774716784.0, 'created_time': 1773134852.845, 'last_price_update_time': 1774695810.978293}
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB22457') HTTP/1.1" 204 0
2026-03-28 11:03:30 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.de] INFO: Scrape type for TW84588: 2
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d, identifier: TW84588
2026-03-28 11:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-28 11:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-28 11:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588 to the API
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:01:17Z',
 'fuel_type': 'petrol',
 'id': '62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW84588',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 94913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-11',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI FIFA World Cup Edition",
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.de] INFO: Saving data for TW84588: {'auction_closing_time': 1774713677.0, 'created_time': 1773308333.631254, 'last_price_update_time': 1774695811.690366}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW84588') HTTP/1.1" 204 0
2026-03-28 11:03:31 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 11:03:31 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-28 11:03:31 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.de] INFO: Scrape type for RR18814: 2
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af41d659-135e-542f-9d13-d19c9a1f9681, identifier: RR18814
2026-03-28 11:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-28 11:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-28 11:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814 to the API
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:28:14Z',
 'fuel_type': 'petrol',
 'id': 'af41d659-135e-542f-9d13-d19c9a1f9681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR18814',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 49483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.de] INFO: Saving data for RR18814: {'auction_closing_time': 1774715294.0, 'created_time': 1773308123.177025, 'last_price_update_time': 1774695812.15848}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR18814') HTTP/1.1" 204 0
2026-03-28 11:03:32 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 11:03:32 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.de] INFO: Scrape type for EE19276: 2
2026-03-28 11:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-28 11:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6, identifier: EE19276
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276 to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:40:50Z',
 'fuel_type': 'hybrid',
 'id': 'bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE19276',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 32219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2020}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.de] INFO: Saving data for EE19276: {'auction_closing_time': 1774716050.0, 'created_time': 1773466752.636531, 'last_price_update_time': 1774695812.613416}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE19276') HTTP/1.1" 204 0
2026-03-28 11:03:32 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 11:03:32 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.de] INFO: Scrape type for NR67134: 2
2026-03-28 11:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-28 11:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcf5d86-8e35-53fe-84a9-cfa0b17efef7, identifier: NR67134
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134 to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:40:14Z',
 'fuel_type': 'petrol',
 'id': 'abcf5d86-8e35-53fe-84a9-cfa0b17efef7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR67134',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 77732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.de] INFO: Saving data for NR67134: {'auction_closing_time': 1774716014.0, 'created_time': 1773830926.891913, 'last_price_update_time': 1774695813.099913}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR67134') HTTP/1.1" 204 0
2026-03-28 11:03:33 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.de] INFO: Scrape type for UJ33462: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aea173f-8d29-55f9-bff2-23473d024d4c, identifier: UJ33462
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462 to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:57:25Z',
 'fuel_type': 'petrol',
 'id': '1aea173f-8d29-55f9-bff2-23473d024d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ33462',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 149615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.de] INFO: Saving data for UJ33462: {'auction_closing_time': 1774717045.0, 'created_time': 1773138689.244776, 'last_price_update_time': 1774695813.581259}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ33462') HTTP/1.1" 204 0
2026-03-28 11:03:33 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.de] INFO: Scrape type for TC26510: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce01dc7d-9804-5e8d-85aa-6c26279a8344, identifier: TC26510
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510 to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:43Z',
 'fuel_type': 'diesel',
 'id': 'ce01dc7d-9804-5e8d-85aa-6c26279a8344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC26510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 239286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-25',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.de] INFO: Saving data for TC26510: {'auction_closing_time': 1774714963.0, 'created_time': 1773685901.418214, 'last_price_update_time': 1774695814.190046}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC26510') HTTP/1.1" 204 0
2026-03-28 11:03:34 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 11:03:34 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.de] INFO: Scrape type for YA68492: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85bbabfd-dd83-5302-a9a9-740c6d226387, identifier: YA68492
2026-03-28 11:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492 to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:00:04Z',
 'fuel_type': 'petrol',
 'id': '85bbabfd-dd83-5302-a9a9-740c6d226387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA68492',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 50564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-12',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2014}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.de] INFO: Saving data for YA68492: {'auction_closing_time': 1774713604.0, 'created_time': 1773345120.763248, 'last_price_update_time': 1774695814.666925}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA68492') HTTP/1.1" 204 0
2026-03-28 11:03:34 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.de] INFO: Scrape type for BD72910: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91, identifier: BD72910
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910 to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:15Z',
 'fuel_type': 'diesel',
 'id': 'c572a2fd-c4e0-5c41-acf1-9272a0e8ad91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD72910',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 197843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2013}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.de] INFO: Saving data for BD72910: {'auction_closing_time': 1774714515.0, 'created_time': 1773469081.61321, 'last_price_update_time': 1774695815.135704}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD72910') HTTP/1.1" 204 0
2026-03-28 11:03:35 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 11:03:35 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.de] INFO: Scrape type for NA53807: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0910a1a-16c2-523b-a9fa-72e8b6d4847a, identifier: NA53807
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-28 11:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807 to the API
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 270,
 'expiration_date': '2026-03-28T16:28:05Z',
 'fuel_type': 'petrol',
 'id': 'd0910a1a-16c2-523b-a9fa-72e8b6d4847a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA53807',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 176178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-15',
 'seller_name': None,
 'title': 'Audi Q5 3.2 V6 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.de] INFO: Saving data for NA53807: {'auction_closing_time': 1774715285.0, 'created_time': 1774607930.729029, 'last_price_update_time': 1774695815.571887}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA53807') HTTP/1.1" 204 0
2026-03-28 11:03:35 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:35 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.de] INFO: Scrape type for MZ26894: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9687abe6-7ee1-5d7a-a821-4c58d61c0379, identifier: MZ26894
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-28 11:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894 to the API
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:18:23Z',
 'fuel_type': 'petrol',
 'id': '9687abe6-7ee1-5d7a-a821-4c58d61c0379',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ26894',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 139556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.de] INFO: Saving data for MZ26894: {'auction_closing_time': 1774714703.0, 'created_time': 1773686256.30235, 'last_price_update_time': 1774695816.017463}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ26894') HTTP/1.1" 204 0
2026-03-28 11:03:36 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 11:03:36 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.de] INFO: Scrape type for AB49272: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c864d2-f226-5120-a71e-75bfa3f07747, identifier: AB49272
2026-03-28 11:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:36 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 11:03:36 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-28 11:03:36 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.de] INFO: Scrape type for UX10113: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3889fa25-cc75-583f-8264-4a13d76c1e8a, identifier: UX10113
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272 to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:05Z',
 'fuel_type': 'diesel',
 'id': '50c864d2-f226-5120-a71e-75bfa3f07747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49272',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 194424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI First Edition',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2021}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.de] INFO: Saving data for AB49272: {'auction_closing_time': 1774713665.0, 'created_time': 1773134489.569824, 'last_price_update_time': 1774695816.568611}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49272') HTTP/1.1" 204 0
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113 to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:42:07Z',
 'fuel_type': 'petrol',
 'id': '3889fa25-cc75-583f-8264-4a13d76c1e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX10113',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 79272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Ice 4x2',
 'transmission': 'manual',
 'trim': 'Ice 4x2',
 'year': 2015}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.de] INFO: Saving data for UX10113: {'auction_closing_time': 1774716127.0, 'created_time': 1773859798.68633, 'last_price_update_time': 1774695816.992312}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX10113') HTTP/1.1" 204 0
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.de] INFO: Scrape type for ZN02812: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a518c9-8f96-5cf6-941c-aafadf099f61 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a518c9-8f96-5cf6-941c-aafadf099f61 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a518c9-8f96-5cf6-941c-aafadf099f61, identifier: ZN02812
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.de] INFO: Scrape type for RJ15430: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0, identifier: RJ15430
2026-03-28 11:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-28 11:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812 to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:22:59Z',
 'fuel_type': 'petrol',
 'id': 'a0a518c9-8f96-5cf6-941c-aafadf099f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN02812',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 183182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.de] INFO: Saving data for ZN02812: {'auction_closing_time': 1774714979.0, 'created_time': 1773138866.989903, 'last_price_update_time': 1774695817.570856}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN02812') HTTP/1.1" 204 0
2026-03-28 11:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-28 11:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430 to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:05:27Z',
 'fuel_type': 'diesel',
 'id': '7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ15430',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 243645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueEfficiency',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency',
 'year': 2012}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.de] INFO: Saving data for RJ15430: {'auction_closing_time': 1774713927.0, 'created_time': 1773858706.705225, 'last_price_update_time': 1774695817.945477}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ15430') HTTP/1.1" 204 0
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 11:03:37 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.de] INFO: Scrape type for BW18754: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817b8bd8-7ade-5c1c-9197-da2b177c3918, identifier: BW18754
2026-03-28 11:03:38 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 11:03:38 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.de] INFO: Scrape type for FU30780: 2
2026-03-28 11:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-28 11:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9beb85a-7c2e-5443-9472-47daa9b91745 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9beb85a-7c2e-5443-9472-47daa9b91745 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9beb85a-7c2e-5443-9472-47daa9b91745, identifier: FU30780
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754 to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:19:11Z',
 'fuel_type': 'petrol',
 'id': '817b8bd8-7ade-5c1c-9197-da2b177c3918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW18754',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 138476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-11',
 'seller_name': None,
 'title': 'Honda Accord 2.4 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2009}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.de] INFO: Saving data for BW18754: {'auction_closing_time': 1774714751.0, 'created_time': 1772544544.427147, 'last_price_update_time': 1774695818.568097}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW18754') HTTP/1.1" 204 0
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780 to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:18:07Z',
 'fuel_type': 'diesel',
 'id': 'd9beb85a-7c2e-5443-9472-47daa9b91745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU30780',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 61634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Titanium',
 'year': 2020}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.de] INFO: Saving data for FU30780: {'auction_closing_time': 1774714687.0, 'created_time': 1774294891.976081, 'last_price_update_time': 1774695818.905464}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU30780') HTTP/1.1" 204 0
2026-03-28 11:03:38 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-28 11:03:38 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.de] INFO: Scrape type for BN30919: 2
2026-03-28 11:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-28 11:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68, identifier: BN30919
2026-03-28 11:03:39 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.de] INFO: Scrape type for BD12559: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13ac1d5-2b60-5704-b8fc-7a2602846219, identifier: BD12559
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-28 11:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919 to the API
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:27:44Z',
 'fuel_type': 'diesel',
 'id': '62e4f9f8-8432-506d-bea7-8fe86bb0cc68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN30919',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 75199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-09',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.de] INFO: Saving data for BN30919: {'auction_closing_time': 1774715264.0, 'created_time': 1774294623.900487, 'last_price_update_time': 1774695819.521343}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN30919') HTTP/1.1" 204 0
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-28 11:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559 to the API
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:57Z',
 'fuel_type': 'diesel',
 'id': 'e13ac1d5-2b60-5704-b8fc-7a2602846219',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD12559',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 146014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-06',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi ST',
 'transmission': 'automatic',
 'trim': 'ST',
 'year': 2017}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.de] INFO: Saving data for BD12559: {'auction_closing_time': 1774715877.0, 'created_time': 1773860716.854447, 'last_price_update_time': 1774695819.963347}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD12559') HTTP/1.1" 204 0
2026-03-28 11:03:39 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 11:03:39 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [auto1.de] INFO: Scrape type for SG28437: 2
2026-03-28 11:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-28 11:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-28 11:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-28 11:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 748b6df4-fbcf-5793-af67-9dae2675bdf7, identifier: SG28437
2026-03-28 11:03:40 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 11:03:40 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [auto1.de] INFO: Scrape type for DB46013: 2
2026-03-28 11:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-28 11:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-28 11:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-28 11:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88abe614-304a-51eb-8deb-bc8dcfc5f306, identifier: DB46013
2026-03-28 11:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-28 11:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-28 11:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437 to the API
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:04Z',
 'fuel_type': 'petrol',
 'id': '748b6df4-fbcf-5793-af67-9dae2675bdf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG28437',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 164065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-17',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [auto1.de] INFO: Saving data for SG28437: {'auction_closing_time': 1774716784.0, 'created_time': 1773427268.636839, 'last_price_update_time': 1774695820.987892}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG28437') HTTP/1.1" 204 0
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-28 11:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013 to the API
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:41:23Z',
 'fuel_type': 'petrol',
 'id': '88abe614-304a-51eb-8deb-bc8dcfc5f306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB46013',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 170400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-29',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Saving data for DB46013: {'auction_closing_time': 1774716083.0, 'created_time': 1774118784.130635, 'last_price_update_time': 1774695821.506851}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB46013') HTTP/1.1" 204 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for DE69910: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ee61fe-a6d5-513c-bf2d-0e876c11d443, identifier: DE69910
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for RF33157: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2b92293-3558-573a-893f-6fb8b8f4a7d9, identifier: RF33157
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-28 11:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910 to the API
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:05Z',
 'fuel_type': 'diesel',
 'id': 'a1ee61fe-a6d5-513c-bf2d-0e876c11d443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE69910',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 145573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.de] INFO: Saving data for DE69910: {'auction_closing_time': 1774715405.0, 'created_time': 1773859723.229698, 'last_price_update_time': 1774695822.103669}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE69910') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-28 11:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157 to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:17Z',
 'fuel_type': 'petrol',
 'id': 'e2b92293-3558-573a-893f-6fb8b8f4a7d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF33157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 137869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.de] INFO: Saving data for RF33157: {'auction_closing_time': 1774714097.0, 'created_time': 1773305292.94173, 'last_price_update_time': 1774695822.414223}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF33157') HTTP/1.1" 204 0
2026-03-28 11:03:42 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.de] INFO: Scrape type for SX47208: 2
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb70950c-5a36-52fa-8491-cc55d6cac244 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb70950c-5a36-52fa-8491-cc55d6cac244 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb70950c-5a36-52fa-8491-cc55d6cac244, identifier: SX47208
2026-03-28 11:03:42 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 11:03:42 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.de] INFO: Scrape type for HE81981: 2
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1, identifier: HE81981
2026-03-28 11:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-28 11:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208 to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:01:32Z',
 'fuel_type': 'diesel',
 'id': 'eb70950c-5a36-52fa-8491-cc55d6cac244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX47208',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 131787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Acenta +',
 'transmission': 'manual',
 'trim': 'Acenta +',
 'year': 2014}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.de] INFO: Saving data for SX47208: {'auction_closing_time': 1774713692.0, 'created_time': 1774607918.471404, 'last_price_update_time': 1774695822.97971}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX47208') HTTP/1.1" 204 0
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-28 11:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981 to the API
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:09:31Z',
 'fuel_type': 'petrol',
 'id': '8031733d-74bb-5c7a-8057-8b7a6c5b67f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE81981',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 173000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Nissan Note 1.4 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2007}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.de] INFO: Saving data for HE81981: {'auction_closing_time': 1774714171.0, 'created_time': 1774089196.476957, 'last_price_update_time': 1774695823.391942}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE81981') HTTP/1.1" 204 0
2026-03-28 11:03:43 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.de] INFO: Scrape type for UN34708: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81577de7-eb3a-5463-9639-51d493d36a3a with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81577de7-eb3a-5463-9639-51d493d36a3a with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81577de7-eb3a-5463-9639-51d493d36a3a, identifier: UN34708
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-28 11:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708 to the API
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:59:59Z',
 'fuel_type': 'diesel',
 'id': '81577de7-eb3a-5463-9639-51d493d36a3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN34708',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 286962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-18',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Cup 2WD',
 'transmission': 'manual',
 'trim': 'Cup 2WD',
 'year': 2008}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.de] INFO: Saving data for UN34708: {'auction_closing_time': 1774717199.0, 'created_time': 1773773678.231912, 'last_price_update_time': 1774695823.819228}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN34708') HTTP/1.1" 204 0
2026-03-28 11:03:43 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 11:03:43 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.de] INFO: Scrape type for JB86141: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5c1fd9e-d176-56bd-ad90-46043809d1e1, identifier: JB86141
2026-03-28 11:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141 to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:02Z',
 'fuel_type': 'diesel',
 'id': 'd5c1fd9e-d176-56bd-ad90-46043809d1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB86141',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 252922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.de] INFO: Saving data for JB86141: {'auction_closing_time': 1774714322.0, 'created_time': 1773303080.55393, 'last_price_update_time': 1774695824.255233}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB86141') HTTP/1.1" 204 0
2026-03-28 11:03:44 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 11:03:44 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.de] INFO: Scrape type for GG89012: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64215c5a-ab4d-5350-a044-f3423f6f20ea, identifier: GG89012
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012 to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:08:35Z',
 'fuel_type': 'petrol',
 'id': '64215c5a-ab4d-5350-a044-f3423f6f20ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG89012',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 57076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 GDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2013}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.de] INFO: Saving data for GG89012: {'auction_closing_time': 1774714115.0, 'created_time': 1773859450.64307, 'last_price_update_time': 1774695824.724968}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG89012') HTTP/1.1" 204 0
2026-03-28 11:03:44 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.de] INFO: Scrape type for LG78390: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88256312-a852-5775-867a-2264f0d900c7 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88256312-a852-5775-867a-2264f0d900c7 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88256312-a852-5775-867a-2264f0d900c7, identifier: LG78390
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390 to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:05:10Z',
 'fuel_type': 'petrol',
 'id': '88256312-a852-5775-867a-2264f0d900c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG78390',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 77653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 N-Tec',
 'transmission': 'automatic',
 'trim': 'N-Tec',
 'year': 2016}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Saving data for LG78390: {'auction_closing_time': 1774713910.0, 'created_time': 1774293263.607878, 'last_price_update_time': 1774695825.151967}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG78390') HTTP/1.1" 204 0
2026-03-28 11:03:45 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for BX10295: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 218e7776-a342-5542-9077-b0be9c8ccbf7, identifier: BX10295
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-28 11:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295 to the API
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:04:17Z',
 'fuel_type': 'petrol',
 'id': '218e7776-a342-5542-9077-b0be9c8ccbf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX10295',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 174695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Saving data for BX10295: {'auction_closing_time': 1774713857.0, 'created_time': 1773773776.410559, 'last_price_update_time': 1774695825.61054}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX10295') HTTP/1.1" 204 0
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for WS69855: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32af0df3-57f2-5180-b5a1-84e2433f86fc, identifier: WS69855
2026-03-28 11:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for EF82631: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b, identifier: EF82631
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-28 11:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855 to the API
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:09:00Z',
 'fuel_type': 'petrol',
 'id': '32af0df3-57f2-5180-b5a1-84e2433f86fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS69855',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 52108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Saving data for WS69855: {'auction_closing_time': 1774714140.0, 'created_time': 1773308242.602443, 'last_price_update_time': 1774695826.321601}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS69855') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-28 11:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-28 11:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631 to the API
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:57:37Z',
 'fuel_type': 'petrol',
 'id': 'fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF82631',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 74750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-14',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Saving data for EF82631: {'auction_closing_time': 1774717057.0, 'created_time': 1773773966.992262, 'last_price_update_time': 1774695826.897583}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF82631') HTTP/1.1" 204 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for DB25597: 2
2026-03-28 11:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-28 11:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74, identifier: DB25597
2026-03-28 11:03:47 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 11:03:47 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 11:03:47 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [auto1.de] INFO: Scrape type for HU16718: 2
2026-03-28 11:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-28 11:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a74c911e-68c6-58e9-b22d-dc2aa97d03a7, identifier: HU16718
2026-03-28 11:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-28 11:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-28 11:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597 to the API
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:56:41Z',
 'fuel_type': 'diesel',
 'id': '0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB25597',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [auto1.de] INFO: Saving data for DB25597: {'auction_closing_time': 1774717001.0, 'created_time': 1773898264.840139, 'last_price_update_time': 1774695827.601713}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB25597') HTTP/1.1" 204 0
2026-03-28 11:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-28 11:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-28 11:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718 to the API
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:18Z',
 'fuel_type': 'petrol',
 'id': 'a74c911e-68c6-58e9-b22d-dc2aa97d03a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU16718',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 152833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2016}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Saving data for HU16718: {'auction_closing_time': 1774715298.0, 'created_time': 1773306426.214923, 'last_price_update_time': 1774695828.054457}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU16718') HTTP/1.1" 204 0
2026-03-28 11:03:48 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Scrape type for LT47109: 2
2026-03-28 11:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-28 11:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26c0ac4b-95b8-5a8b-968d-df677fc18d31, identifier: LT47109
2026-03-28 11:03:48 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Scrape type for HA99169: 2
2026-03-28 11:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-28 11:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d02b93fe-7708-5ebe-aed6-8eccae35fb81, identifier: HA99169
2026-03-28 11:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-28 11:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-28 11:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109 to the API
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:45:04Z',
 'fuel_type': 'petrol',
 'id': '26c0ac4b-95b8-5a8b-968d-df677fc18d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47109',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 134954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2018}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Saving data for LT47109: {'auction_closing_time': 1774716304.0, 'created_time': 1773741883.359919, 'last_price_update_time': 1774695828.592231}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT47109') HTTP/1.1" 204 0
2026-03-28 11:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-28 11:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-28 11:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169 to the API
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:14:36Z',
 'fuel_type': 'diesel',
 'id': 'd02b93fe-7708-5ebe-aed6-8eccae35fb81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA99169',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2019}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Saving data for HA99169: {'auction_closing_time': 1774714476.0, 'created_time': 1773830069.665637, 'last_price_update_time': 1774695828.888899}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA99169') HTTP/1.1" 204 0
2026-03-28 11:03:48 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [auto1.de] INFO: Scrape type for ZT78140: 2
2026-03-28 11:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-28 11:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6617bcf8-7d0d-58bc-af17-a622fc461013, identifier: ZT78140
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.de] INFO: Scrape type for VY38504: 2
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5, identifier: VY38504
2026-03-28 11:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-28 11:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-28 11:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140 to the API
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:26:48Z',
 'fuel_type': 'petrol',
 'id': '6617bcf8-7d0d-58bc-af17-a622fc461013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT78140',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 62430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-26',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.de] INFO: Saving data for ZT78140: {'auction_closing_time': 1774715208.0, 'created_time': 1774032500.474021, 'last_price_update_time': 1774695829.469469}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT78140') HTTP/1.1" 204 0
2026-03-28 11:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-28 11:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-28 11:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504 to the API
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:46Z',
 'fuel_type': 'petrol',
 'id': '1e6ea5b5-9c84-5faf-bee5-397c07a344e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY38504',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 202407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2013}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.de] INFO: Saving data for VY38504: {'auction_closing_time': 1774717006.0, 'created_time': 1773469060.326289, 'last_price_update_time': 1774695829.915496}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY38504') HTTP/1.1" 204 0
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 11:03:49 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.de] INFO: Scrape type for SY85938: 2
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142b977a-64dc-5d77-9022-f457bb951ffb, identifier: SY85938
2026-03-28 11:03:50 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.de] INFO: Scrape type for ZV87570: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b34e2845-5567-540c-9e19-1356d8ef5629, identifier: ZV87570
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938 to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:53:47Z',
 'fuel_type': 'petrol',
 'id': '142b977a-64dc-5d77-9022-f457bb951ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY85938',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.de] INFO: Saving data for SY85938: {'auction_closing_time': 1774716827.0, 'created_time': 1773427041.458803, 'last_price_update_time': 1774695830.504413}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY85938') HTTP/1.1" 204 0
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570 to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'electro',
 'id': 'b34e2845-5567-540c-9e19-1356d8ef5629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV87570',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 11,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.de] INFO: Saving data for ZV87570: {'auction_closing_time': 1774714325.0, 'created_time': 1774607929.028973, 'last_price_update_time': 1774695830.871442}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV87570') HTTP/1.1" 204 0
2026-03-28 11:03:50 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 11:03:50 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.de] INFO: Scrape type for WP81367: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0af088b-a073-53fb-9e7e-7eb5823956b9, identifier: WP81367
2026-03-28 11:03:51 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.de] INFO: Scrape type for AV25336: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7684311f-9023-5752-ad89-ae2b4edace59, identifier: AV25336
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-28 11:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367 to the API
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:00:58Z',
 'fuel_type': 'petrol',
 'id': 'a0af088b-a073-53fb-9e7e-7eb5823956b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP81367',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 108086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Classic',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Classic',
 'year': 2010}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.de] INFO: Saving data for WP81367: {'auction_closing_time': 1774713658.0, 'created_time': 1773860260.499782, 'last_price_update_time': 1774695831.481505}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP81367') HTTP/1.1" 204 0
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-28 11:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336 to the API
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:35Z',
 'fuel_type': 'diesel',
 'id': '7684311f-9023-5752-ad89-ae2b4edace59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV25336',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 138703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-18',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.de] INFO: Saving data for AV25336: {'auction_closing_time': 1774716395.0, 'created_time': 1773468410.629751, 'last_price_update_time': 1774695831.842533}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV25336') HTTP/1.1" 204 0
2026-03-28 11:03:51 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.de] INFO: Scrape type for VS89530: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1, identifier: VS89530
2026-03-28 11:03:51 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.de] INFO: Scrape type for YV09971: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0ca242c-b1ce-5eb1-b043-e3b0405fc282, identifier: YV09971
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-28 11:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530 to the API
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:28:17Z',
 'fuel_type': 'petrol',
 'id': '7350c2eb-76a5-5cf0-95b6-65a0c94c46a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89530',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 150516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2019}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.de] INFO: Saving data for VS89530: {'auction_closing_time': 1774715297.0, 'created_time': 1773513684.443549, 'last_price_update_time': 1774695832.493523}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS89530') HTTP/1.1" 204 0
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-28 11:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971 to the API
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': 'd0ca242c-b1ce-5eb1-b043-e3b0405fc282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV09971',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 89766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.de] INFO: Saving data for YV09971: {'auction_closing_time': 1774713997.0, 'created_time': 1773304612.746314, 'last_price_update_time': 1774695832.883125}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV09971') HTTP/1.1" 204 0
2026-03-28 11:03:52 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.de] INFO: Scrape type for DU96107: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431d12da-7f3a-5e79-942f-3b06fcca8ab7, identifier: DU96107
2026-03-28 11:03:53 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.de] INFO: Scrape type for SJ02075: 2
2026-03-28 11:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-28 11:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec67ed56-0091-57b5-bfad-1c365132b915, identifier: SJ02075
2026-03-28 11:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-28 11:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107 to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:09:37Z',
 'fuel_type': 'petrol',
 'id': '431d12da-7f3a-5e79-942f-3b06fcca8ab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU96107',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 143658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.de] INFO: Saving data for DU96107: {'auction_closing_time': 1774714177.0, 'created_time': 1773811828.120291, 'last_price_update_time': 1774695833.452794}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU96107') HTTP/1.1" 204 0
2026-03-28 11:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-28 11:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075 to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'diesel',
 'id': 'ec67ed56-0091-57b5-bfad-1c365132b915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ02075',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 186241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'BMW 1er 123d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.de] INFO: Saving data for SJ02075: {'auction_closing_time': 1774714217.0, 'created_time': 1773305763.373075, 'last_price_update_time': 1774695834.244323}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ02075') HTTP/1.1" 204 0
2026-03-28 11:03:54 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 11:03:54 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.de] INFO: Scrape type for EJ80862: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1b8f8f-310e-5dd9-90ca-39450663815f, identifier: EJ80862
2026-03-28 11:03:54 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 11:03:54 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.de] INFO: Scrape type for CT53994: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80d2dad0-7181-5cd1-9608-e2d3918173ba, identifier: CT53994
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862 to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:25:40Z',
 'fuel_type': 'diesel',
 'id': 'ce1b8f8f-310e-5dd9-90ca-39450663815f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ80862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 60064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2016}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.de] INFO: Saving data for EJ80862: {'auction_closing_time': 1774715140.0, 'created_time': 1773306596.062804, 'last_price_update_time': 1774695834.809067}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ80862') HTTP/1.1" 204 0
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994 to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:07:43Z',
 'fuel_type': 'petrol',
 'id': '80d2dad0-7181-5cd1-9608-e2d3918173ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT53994',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 137039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.de] INFO: Saving data for CT53994: {'auction_closing_time': 1774714063.0, 'created_time': 1773859659.327243, 'last_price_update_time': 1774695835.148624}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT53994') HTTP/1.1" 204 0
2026-03-28 11:03:55 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 11:03:55 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 11:03:55 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.de] INFO: Scrape type for YS06113: 2
2026-03-28 11:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-28 11:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20b4f624-7b43-5d67-96d9-efabbce6d4be, identifier: YS06113
2026-03-28 11:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:55 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.de] INFO: Scrape type for BZ09697: 2
2026-03-28 11:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-28 11:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ef7598-ba83-523c-89e6-32bc73e121d3, identifier: BZ09697
2026-03-28 11:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-28 11:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-28 11:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113 to the API
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:58:51Z',
 'fuel_type': 'diesel',
 'id': '20b4f624-7b43-5d67-96d9-efabbce6d4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS06113',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 165944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2016}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.de] INFO: Saving data for YS06113: {'auction_closing_time': 1774717131.0, 'created_time': 1773858992.489227, 'last_price_update_time': 1774695835.75808}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS06113') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-28 11:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-28 11:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697 to the API
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': '18ef7598-ba83-523c-89e6-32bc73e121d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ09697',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 113182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2018}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.de] INFO: Saving data for BZ09697: {'auction_closing_time': 1774716351.0, 'created_time': 1773860086.480419, 'last_price_update_time': 1774695836.124463}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ09697') HTTP/1.1" 204 0
2026-03-28 11:03:56 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.de] INFO: Scrape type for BP65975: 2
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5874bb0-3d59-5c63-aa90-7bfcd5e83901, identifier: BP65975
2026-03-28 11:03:56 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 11:03:56 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.de] INFO: Scrape type for DM27996: 2
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d, identifier: DM27996
2026-03-28 11:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-28 11:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975 to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': 'f5874bb0-3d59-5c63-aa90-7bfcd5e83901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP65975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 77072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2018}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.de] INFO: Saving data for BP65975: {'auction_closing_time': 1774714544.0, 'created_time': 1772729716.244316, 'last_price_update_time': 1774695836.818378}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP65975') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-28 11:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-28 11:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996 to the API
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': '7bc00823-3ffb-544d-be7d-5f2e5ea06d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27996',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 111162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.de] INFO: Saving data for DM27996: {'auction_closing_time': 1774716663.0, 'created_time': 1773305985.666831, 'last_price_update_time': 1774695837.418964}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM27996') HTTP/1.1" 204 0
2026-03-28 11:03:57 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 11:03:57 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 11:03:57 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 11:03:57 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.de] INFO: Scrape type for JJ95706: 2
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 792a383f-5ada-5cad-aff3-20fca48a9ef3, identifier: JJ95706
2026-03-28 11:03:57 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:57 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.de] INFO: Scrape type for TL87064: 2
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f37a7713-284f-522c-8080-133b27842212, identifier: TL87064
2026-03-28 11:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-28 11:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-28 11:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706 to the API
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:05Z',
 'fuel_type': 'petrol',
 'id': '792a383f-5ada-5cad-aff3-20fca48a9ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ95706',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 134490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.de] INFO: Saving data for JJ95706: {'auction_closing_time': 1774716425.0, 'created_time': 1773306242.316934, 'last_price_update_time': 1774695838.148591}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ95706') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-28 11:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-28 11:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064 to the API
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:26Z',
 'fuel_type': 'diesel',
 'id': 'f37a7713-284f-522c-8080-133b27842212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL87064',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 365118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Soleil',
 'transmission': 'automatic',
 'trim': 'Soleil',
 'year': 2019}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.de] INFO: Saving data for TL87064: {'auction_closing_time': 1774715726.0, 'created_time': 1773384981.848925, 'last_price_update_time': 1774695838.453365}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL87064') HTTP/1.1" 204 0
2026-03-28 11:03:58 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.de] INFO: Scrape type for VJ30367: 2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2fff70-2fd9-5ab4-9025-64876178bbdc, identifier: VJ30367
2026-03-28 11:03:58 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 11:03:58 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.de] INFO: Scrape type for HT39177: 2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f24e68-8bfa-54b5-ba08-7183d096ae6c, identifier: HT39177
2026-03-28 11:03:58 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 11:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-28 11:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-28 11:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367 to the API
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:38:43Z',
 'fuel_type': 'diesel',
 'id': '6f2fff70-2fd9-5ab4-9025-64876178bbdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ30367',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 158168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2021}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.de] INFO: Saving data for VJ30367: {'auction_closing_time': 1774715923.0, 'created_time': 1774293750.358969, 'last_price_update_time': 1774695839.06157}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ30367') HTTP/1.1" 204 0
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177 to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:30:47Z',
 'fuel_type': 'petrol',
 'id': '89f24e68-8bfa-54b5-ba08-7183d096ae6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT39177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 89412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2017}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.de] INFO: Saving data for HT39177: {'auction_closing_time': 1774715447.0, 'created_time': 1773775723.47669, 'last_price_update_time': 1774695839.394061}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT39177') HTTP/1.1" 204 0
2026-03-28 11:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.de] INFO: Scrape type for RJ05854: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed86ad48-c4c3-5949-b718-5af2115b333b, identifier: RJ05854
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 11:03:59 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.de] INFO: Scrape type for TF11415: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13dba2c-13a0-548b-921d-6f253b3f702b, identifier: TF11415
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854 to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:46Z',
 'fuel_type': 'petrol',
 'id': 'ed86ad48-c4c3-5949-b718-5af2115b333b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ05854',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 139140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2016}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.de] INFO: Saving data for RJ05854: {'auction_closing_time': 1774715806.0, 'created_time': 1773662083.307689, 'last_price_update_time': 1774695839.938222}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ05854') HTTP/1.1" 204 0
2026-03-28 11:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-28 11:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-28 11:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415 to the API
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:04Z',
 'fuel_type': 'diesel',
 'id': 'e13dba2c-13a0-548b-921d-6f253b3f702b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF11415',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 64319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Nissan Note 1.5 dCi I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2013}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.de] INFO: Saving data for TF11415: {'auction_closing_time': 1774714684.0, 'created_time': 1773858984.851893, 'last_price_update_time': 1774695840.583852}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF11415') HTTP/1.1" 204 0
2026-03-28 11:04:00 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.de] INFO: Scrape type for SD97280: 2
2026-03-28 11:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-28 11:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9, identifier: SD97280
2026-03-28 11:04:00 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.de] INFO: Scrape type for YH44518: 2
2026-03-28 11:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-28 11:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7b33f1f-bbf1-5f55-928b-1d4c8b426094, identifier: YH44518
2026-03-28 11:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-28 11:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-28 11:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280 to the API
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:43Z',
 'fuel_type': 'diesel',
 'id': '7b5963f9-ef84-5b9f-a541-c9a37890e0a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97280',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 185187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D3 Linje Business',
 'transmission': 'manual',
 'trim': 'Linje Business',
 'year': 2015}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.de] INFO: Saving data for SD97280: {'auction_closing_time': 1774715563.0, 'created_time': 1773134171.075775, 'last_price_update_time': 1774695841.600417}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97280') HTTP/1.1" 204 0
2026-03-28 11:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-28 11:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-28 11:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518 to the API
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:22:54Z',
 'fuel_type': 'petrol',
 'id': 'd7b33f1f-bbf1-5f55-928b-1d4c8b426094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44518',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 11414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2025}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.de] INFO: Saving data for YH44518: {'auction_closing_time': 1774714974.0, 'created_time': 1773858701.891021, 'last_price_update_time': 1774695841.92284}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44518') HTTP/1.1" 204 0
2026-03-28 11:04:01 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.de] INFO: Scrape type for YT67181: 2
2026-03-28 11:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-28 11:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9, identifier: YT67181
2026-03-28 11:04:02 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.de] INFO: Scrape type for ER78775: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 831a3654-c90d-5d42-87ba-34576e961bd9, identifier: ER78775
2026-03-28 11:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-28 11:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181 to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:00:47Z',
 'fuel_type': 'petrol',
 'id': 'fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT67181',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 178672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-24',
 'seller_name': None,
 'title': 'Nissan Note 1.2 Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2016}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.de] INFO: Saving data for YT67181: {'auction_closing_time': 1774713647.0, 'created_time': 1774293944.070075, 'last_price_update_time': 1774695842.485123}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT67181') HTTP/1.1" 204 0
2026-03-28 11:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-28 11:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775 to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:32Z',
 'fuel_type': 'diesel',
 'id': '831a3654-c90d-5d42-87ba-34576e961bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER78775',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 200541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.de] INFO: Saving data for ER78775: {'auction_closing_time': 1774716392.0, 'created_time': 1773303078.609264, 'last_price_update_time': 1774695842.825649}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER78775') HTTP/1.1" 204 0
2026-03-28 11:04:02 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.de] INFO: Scrape type for SG31546: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97721150-39b3-508d-bcd7-3425d0af4042, identifier: SG31546
2026-03-28 11:04:02 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.de] INFO: Scrape type for PS26933: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af54d5ef-77e0-5dd9-832a-db5628a4e2ee, identifier: PS26933
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-28 11:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-28 11:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546 to the API
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:04:40Z',
 'fuel_type': 'petrol',
 'id': '97721150-39b3-508d-bcd7-3425d0af4042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG31546',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 215543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.de] INFO: Saving data for SG31546: {'auction_closing_time': 1774713880.0, 'created_time': 1774089225.127555, 'last_price_update_time': 1774695843.415464}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG31546') HTTP/1.1" 204 0
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-28 11:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-28 11:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933 to the API
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:15:27Z',
 'fuel_type': 'diesel',
 'id': 'af54d5ef-77e0-5dd9-832a-db5628a4e2ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS26933',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 227541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.de] INFO: Saving data for PS26933: {'auction_closing_time': 1774714527.0, 'created_time': 1773399285.810597, 'last_price_update_time': 1774695843.724576}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS26933') HTTP/1.1" 204 0
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.de] INFO: Scrape type for HE92439: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef224bb-6015-537b-9b19-ef4e79c364e7, identifier: HE92439
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 11:04:03 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.de] INFO: Scrape type for ZZ59930: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1519479c-f49e-5f48-a2b2-a37769cd0ed4, identifier: ZZ59930
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439 to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:32:16Z',
 'fuel_type': 'petrol',
 'id': 'bef224bb-6015-537b-9b19-ef4e79c364e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE92439',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 84871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.de] INFO: Saving data for HE92439: {'auction_closing_time': 1774715536.0, 'created_time': 1774330261.393096, 'last_price_update_time': 1774695844.377971}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE92439') HTTP/1.1" 204 0
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930 to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:20Z',
 'fuel_type': 'petrol',
 'id': '1519479c-f49e-5f48-a2b2-a37769cd0ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ59930',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 150118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.de] INFO: Saving data for ZZ59930: {'auction_closing_time': 1774716200.0, 'created_time': 1773859271.207919, 'last_price_update_time': 1774695844.851951}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ59930') HTTP/1.1" 204 0
2026-03-28 11:04:04 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 11:04:04 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.de] INFO: Scrape type for FP37093: 2
2026-03-28 11:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-28 11:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194, identifier: FP37093
2026-03-28 11:04:05 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.de] INFO: Scrape type for CE41516: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8368a6a4-80d7-56a6-8792-967a3273d302, identifier: CE41516
2026-03-28 11:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-28 11:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-28 11:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093 to the API
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:44Z',
 'fuel_type': 'petrol',
 'id': '9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP37093',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 113695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.de] INFO: Saving data for FP37093: {'auction_closing_time': 1774716404.0, 'created_time': 1774292914.669988, 'last_price_update_time': 1774695845.435833}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP37093') HTTP/1.1" 204 0
2026-03-28 11:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-28 11:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-28 11:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516 to the API
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:51Z',
 'fuel_type': 'diesel',
 'id': '8368a6a4-80d7-56a6-8792-967a3273d302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE41516',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 200728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.de] INFO: Saving data for CE41516: {'auction_closing_time': 1774715451.0, 'created_time': 1773305258.71597, 'last_price_update_time': 1774695845.769948}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE41516') HTTP/1.1" 204 0
2026-03-28 11:04:05 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.de] INFO: Scrape type for RV99753: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe, identifier: RV99753
2026-03-28 11:04:05 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.de] INFO: Scrape type for TT79830: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e04542-d2c8-52f1-a0e2-68ba5702e980, identifier: TT79830
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-28 11:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753 to the API
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'petrol',
 'id': 'fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV99753',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'QX70',
 'odometer': 164895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Infiniti QX70 3.7 V6 S Design',
 'transmission': 'automatic',
 'trim': 'S Design',
 'year': 2017}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.de] INFO: Saving data for RV99753: {'auction_closing_time': 1774716492.0, 'created_time': 1774294730.078686, 'last_price_update_time': 1774695846.330657}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV99753') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-28 11:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830 to the API
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:36:53Z',
 'fuel_type': 'petrol',
 'id': 'e2e04542-d2c8-52f1-a0e2-68ba5702e980',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT79830',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 98225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.de] INFO: Saving data for TT79830: {'auction_closing_time': 1774715813.0, 'created_time': 1773467974.405456, 'last_price_update_time': 1774695846.651137}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT79830') HTTP/1.1" 204 0
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.de] INFO: Scrape type for WT86563: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609db12b-2ba2-51fd-88b4-fb8ddb490b57, identifier: WT86563
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-28 11:04:06 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.de] INFO: Scrape type for NM34350: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 469b614c-03f3-5918-9632-ebdc8c3a0485, identifier: NM34350
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-28 11:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563 to the API
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:42:46Z',
 'fuel_type': 'diesel',
 'id': '609db12b-2ba2-51fd-88b4-fb8ddb490b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT86563',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 191953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Sport 4x4',
 'transmission': 'manual',
 'trim': 'Sport 4x4',
 'year': 2012}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.de] INFO: Saving data for WT86563: {'auction_closing_time': 1774716166.0, 'created_time': 1774294028.121884, 'last_price_update_time': 1774695847.253712}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT86563') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-28 11:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-28 11:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350 to the API
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:06:24Z',
 'fuel_type': 'diesel',
 'id': '469b614c-03f3-5918-9632-ebdc8c3a0485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM34350',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 121559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend Edition',
 'transmission': 'automatic',
 'trim': 'kompakt Trend Edition',
 'year': 2012}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.de] INFO: Saving data for NM34350: {'auction_closing_time': 1774713984.0, 'created_time': 1773399879.682511, 'last_price_update_time': 1774695847.702764}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM34350') HTTP/1.1" 204 0
2026-03-28 11:04:07 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 11:04:07 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.de] INFO: Scrape type for FZ89308: 2
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a58b375-3a87-59f9-ae00-7f403ab98cf2, identifier: FZ89308
2026-03-28 11:04:07 [scrapy.extensions.logstats] INFO: Crawled 421 pages (at 4 pages/min), scraped 595 items (at 77 items/min)
2026-03-28 11:04:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-28 11:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-28 11:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308 to the API
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:10:33Z',
 'fuel_type': 'petrol',
 'id': '1a58b375-3a87-59f9-ae00-7f403ab98cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ89308',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 90524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2015}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.de] INFO: Saving data for FZ89308: {'auction_closing_time': 1774714233.0, 'created_time': 1773402633.913659, 'last_price_update_time': 1774695848.158734}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ89308') HTTP/1.1" 204 0
2026-03-28 11:04:08 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 11:04:08 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.de] INFO: Scrape type for EC74122: 2
2026-03-28 11:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-28 11:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f7f938c-6705-56f6-8369-1a2c88126fb1, identifier: EC74122
2026-03-28 11:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-28 11:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-28 11:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122 to the API
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:12:07Z',
 'fuel_type': 'diesel',
 'id': '4f7f938c-6705-56f6-8369-1a2c88126fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC74122',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-23',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.de] INFO: Saving data for EC74122: {'auction_closing_time': 1774714327.0, 'created_time': 1773775452.361819, 'last_price_update_time': 1774695848.592838}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC74122') HTTP/1.1" 204 0
2026-03-28 11:04:08 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.de] INFO: Scrape type for LH09734: 2
2026-03-28 11:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-28 11:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c443d6-9323-5407-b7d9-0540c9b1d9f4, identifier: LH09734
2026-03-28 11:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-28 11:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-28 11:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734 to the API
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:17Z',
 'fuel_type': 'diesel',
 'id': 'd4c443d6-9323-5407-b7d9-0540c9b1d9f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH09734',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 31533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.de] INFO: Saving data for LH09734: {'auction_closing_time': 1774715597.0, 'created_time': 1773427264.380778, 'last_price_update_time': 1774695849.025609}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH09734') HTTP/1.1" 204 0
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.de] INFO: Scrape type for XU64075: 2
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b601aab1-2b2d-58d2-aff6-7f7f8b39a580, identifier: XU64075
2026-03-28 11:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-28 11:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-28 11:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075 to the API
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:35:26Z',
 'fuel_type': 'diesel',
 'id': 'b601aab1-2b2d-58d2-aff6-7f7f8b39a580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU64075',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 328288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.de] INFO: Saving data for XU64075: {'auction_closing_time': 1774715726.0, 'created_time': 1773304017.773538, 'last_price_update_time': 1774695849.48926}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU64075') HTTP/1.1" 204 0
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 11:04:09 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.de] INFO: Scrape type for LU00556: 2
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c72a94ab-7559-5825-80dc-ac144a55c6fb, identifier: LU00556
2026-03-28 11:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-28 11:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-28 11:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556 to the API
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:43Z',
 'fuel_type': 'diesel',
 'id': 'c72a94ab-7559-5825-80dc-ac144a55c6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU00556',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 144636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
 'transmission': 'manual',
 'trim': 'Active L1',
 'year': 2020}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.de] INFO: Saving data for LU00556: {'auction_closing_time': 1774716763.0, 'created_time': 1773402613.122351, 'last_price_update_time': 1774695849.967058}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU00556') HTTP/1.1" 204 0
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:10 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 11:04:10 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.de] INFO: Scrape type for MU33695: 2
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d33d2238-88ae-5a7a-85d8-0d819d5ede91, identifier: MU33695
2026-03-28 11:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-28 11:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-28 11:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695 to the API
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:20Z',
 'fuel_type': 'petrol',
 'id': 'd33d2238-88ae-5a7a-85d8-0d819d5ede91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU33695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 214685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.de] INFO: Saving data for MU33695: {'auction_closing_time': 1774716380.0, 'created_time': 1773774702.208202, 'last_price_update_time': 1774695850.556046}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU33695') HTTP/1.1" 204 0
2026-03-28 11:04:10 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 11:04:10 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.de] INFO: Scrape type for LH51780: 2
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f, identifier: LH51780
2026-03-28 11:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-28 11:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-28 11:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780 to the API
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:12:32Z',
 'fuel_type': 'petrol',
 'id': '32a8b10d-fbc0-59e5-8207-1759ab8fc68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH51780',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 27165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.de] INFO: Saving data for LH51780: {'auction_closing_time': 1774714352.0, 'created_time': 1773773688.207965, 'last_price_update_time': 1774695850.99262}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH51780') HTTP/1.1" 204 0
2026-03-28 11:04:11 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9700 | hits on page: 40
2026-03-28 11:04:11 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.de] INFO: Scrape type for VG52113: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a063b2c-7622-504b-8065-89a3b3ca6eea, identifier: VG52113
2026-03-28 11:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-28 11:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-28 11:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113 to the API
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:26Z',
 'fuel_type': 'diesel',
 'id': '9a063b2c-7622-504b-8065-89a3b3ca6eea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52113',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 230400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-22',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line AWD',
 'year': 2015}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.de] INFO: Saving data for VG52113: {'auction_closing_time': 1774715546.0, 'created_time': 1773307526.762141, 'last_price_update_time': 1774695851.461261}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG52113') HTTP/1.1" 204 0
2026-03-28 11:04:11 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 11:04:11 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.de] INFO: Scrape type for ZN63350: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5255c63-9d44-5f4d-8c46-71e9682a5d9e, identifier: ZN63350
2026-03-28 11:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:11 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.de] INFO: Scrape type for LU75285: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2ab30ba-586e-50e6-a31c-16bf841dba46, identifier: LU75285
2026-03-28 11:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-28 11:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-28 11:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350 to the API
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'petrol',
 'id': 'b5255c63-9d44-5f4d-8c46-71e9682a5d9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN63350',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 204047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2010}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.de] INFO: Saving data for ZN63350: {'auction_closing_time': 1774715322.0, 'created_time': 1773304071.171059, 'last_price_update_time': 1774695852.050823}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN63350') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-28 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285 to the API
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:00:26Z',
 'fuel_type': 'petrol',
 'id': 'f2ab30ba-586e-50e6-a31c-16bf841dba46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU75285',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 84656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.de] INFO: Saving data for LU75285: {'auction_closing_time': 1774713626.0, 'created_time': 1773513939.245053, 'last_price_update_time': 1774695852.400046}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU75285') HTTP/1.1" 204 0
2026-03-28 11:04:12 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.de] INFO: Scrape type for CW59742: 2
2026-03-28 11:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-28 11:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7c1e35-d42d-5997-bd20-ad05c7b63589, identifier: CW59742
2026-03-28 11:04:12 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.de] INFO: Scrape type for AJ71122: 2
2026-03-28 11:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-28 11:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e623ff-fe03-5500-8a70-06d78fa7c337, identifier: AJ71122
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-28 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742 to the API
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:47Z',
 'fuel_type': 'diesel',
 'id': 'fc7c1e35-d42d-5997-bd20-ad05c7b63589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW59742',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 274134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2014}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.de] INFO: Saving data for CW59742: {'auction_closing_time': 1774714967.0, 'created_time': 1773467233.793212, 'last_price_update_time': 1774695852.976145}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW59742') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122 to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-28T16:15:12Z',
 'fuel_type': 'diesel',
 'id': '68e623ff-fe03-5500-8a70-06d78fa7c337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ71122',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 141585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.de] INFO: Saving data for AJ71122: {'auction_closing_time': 1774714512.0, 'created_time': 1774290715.357785, 'last_price_update_time': 1774695853.305659}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ71122') HTTP/1.1" 204 0
2026-03-28 11:04:13 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 11:04:13 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 11:04:13 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.de] INFO: Scrape type for GV91046: 2
2026-03-28 11:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-28 11:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d, identifier: GV91046
2026-03-28 11:04:13 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 11:04:13 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.de] INFO: Scrape type for SV69616: 2
2026-03-28 11:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-28 11:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59508b96-73c2-5cd2-9114-4b2a79eea019, identifier: SV69616
2026-03-28 11:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-28 11:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046 to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:48:30Z',
 'fuel_type': 'diesel',
 'id': '4ba1abf2-d22f-5f6b-9b6d-ee032405443d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91046',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 342414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2014}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.de] INFO: Saving data for GV91046: {'auction_closing_time': 1774716510.0, 'created_time': 1773308234.094236, 'last_price_update_time': 1774695853.848398}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91046') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-28 11:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616 to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:46Z',
 'fuel_type': 'petrol',
 'id': '59508b96-73c2-5cd2-9114-4b2a79eea019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV69616',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 164705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-24',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.de] INFO: Saving data for SV69616: {'auction_closing_time': 1774713886.0, 'created_time': 1773688144.745135, 'last_price_update_time': 1774695854.265808}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV69616') HTTP/1.1" 204 0
2026-03-28 11:04:14 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.de] INFO: Scrape type for LK48428: 2
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-28 11:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675f2836-9cde-5ead-b747-720b04f8b9e0 with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675f2836-9cde-5ead-b747-720b04f8b9e0 with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675f2836-9cde-5ead-b747-720b04f8b9e0, identifier: LK48428
2026-03-28 11:04:14 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.de] INFO: Scrape type for CH61883: 2
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-28 11:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6827502-9748-5ffa-82d2-b1efd8b2a7bb with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6827502-9748-5ffa-82d2-b1efd8b2a7bb with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6827502-9748-5ffa-82d2-b1efd8b2a7bb, identifier: CH61883
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428 to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:53:47Z',
 'fuel_type': 'petrol',
 'id': '675f2836-9cde-5ead-b747-720b04f8b9e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK48428',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 324842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 230 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 1996}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.de] INFO: Saving data for LK48428: {'auction_closing_time': 1774716827.0, 'created_time': 1773513702.724251, 'last_price_update_time': 1774695854.814768}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK48428') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883 to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:10:28Z',
 'fuel_type': 'diesel',
 'id': 'f6827502-9748-5ffa-82d2-b1efd8b2a7bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH61883',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 54299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.de] INFO: Saving data for CH61883: {'auction_closing_time': 1774714228.0, 'created_time': 1773223359.013735, 'last_price_update_time': 1774695855.176668}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH61883') HTTP/1.1" 204 0
2026-03-28 11:04:15 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.de] INFO: Scrape type for HM04457: 2
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b, identifier: HM04457
2026-03-28 11:04:15 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-28 11:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457 to the API
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04457',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 129544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.de] INFO: Saving data for HM04457: {'auction_closing_time': 1774715601.0, 'created_time': 1773304569.610432, 'last_price_update_time': 1774695855.634429}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM04457') HTTP/1.1" 204 0
2026-03-28 11:04:15 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.de] INFO: Scrape type for WP61796: 2
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5fb3c71-baf8-57b0-b50a-36aa058df703, identifier: WP61796
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-28 11:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796 to the API
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:27:07Z',
 'fuel_type': 'diesel',
 'id': 'e5fb3c71-baf8-57b0-b50a-36aa058df703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP61796',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 102537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-06',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Saving data for WP61796: {'auction_closing_time': 1774715227.0, 'created_time': 1774263553.410733, 'last_price_update_time': 1774695856.090884}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP61796') HTTP/1.1" 204 0
2026-03-28 11:04:16 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Scrape type for DE42625: 2
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-28 11:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5565833-2ca2-5e96-bd88-9461c4c07921, identifier: DE42625
2026-03-28 11:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-28 11:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625 to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:29:54Z',
 'fuel_type': 'petrol',
 'id': 'b5565833-2ca2-5e96-bd88-9461c4c07921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42625',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 218247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Saving data for DE42625: {'auction_closing_time': 1774715394.0, 'created_time': 1773686583.058438, 'last_price_update_time': 1774695856.516032}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42625') HTTP/1.1" 204 0
2026-03-28 11:04:16 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Scrape type for AX24898: 2
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-28 11:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b88c956-0637-58d3-9fb4-559647cdea4f, identifier: AX24898
2026-03-28 11:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-28 11:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898 to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:12:00Z',
 'fuel_type': 'diesel',
 'id': '8b88c956-0637-58d3-9fb4-559647cdea4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX24898',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 194736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-07',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Saving data for AX24898: {'auction_closing_time': 1774714320.0, 'created_time': 1773859000.797888, 'last_price_update_time': 1774695856.950022}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX24898') HTTP/1.1" 204 0
2026-03-28 11:04:16 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.de] INFO: Scrape type for FA59135: 2
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-28 11:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bff56ec-3cd3-5581-b680-7155ce09e3fb, identifier: FA59135
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-28 11:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135 to the API
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:11:49Z',
 'fuel_type': 'petrol',
 'id': '4bff56ec-3cd3-5581-b680-7155ce09e3fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA59135',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 106039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-16',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.de] INFO: Saving data for FA59135: {'auction_closing_time': 1774714309.0, 'created_time': 1774293440.805188, 'last_price_update_time': 1774695857.380528}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA59135') HTTP/1.1" 204 0
2026-03-28 11:04:17 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.de] INFO: Scrape type for MU44330: 2
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-28 11:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bd6aa9b-9088-5e3d-af89-c37292938060, identifier: MU44330
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-28 11:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330 to the API
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:00:06Z',
 'fuel_type': 'petrol',
 'id': '5bd6aa9b-9088-5e3d-af89-c37292938060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU44330',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 64819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Elegance Start/Stop',
 'year': 2020}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.de] INFO: Saving data for MU44330: {'auction_closing_time': 1774713606.0, 'created_time': 1773860936.7361, 'last_price_update_time': 1774695857.850108}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU44330') HTTP/1.1" 204 0
2026-03-28 11:04:17 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 11:04:17 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 11:04:17 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.de] INFO: Scrape type for KX79678: 2
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-28 11:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4207b5d9-b583-5de5-a664-8aa73e57ada5, identifier: KX79678
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-28 11:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678 to the API
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:57Z',
 'fuel_type': 'petrol',
 'id': '4207b5d9-b583-5de5-a664-8aa73e57ada5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX79678',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 96029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2015}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.de] INFO: Saving data for KX79678: {'auction_closing_time': 1774714497.0, 'created_time': 1773306116.14845, 'last_price_update_time': 1774695858.305317}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX79678') HTTP/1.1" 204 0
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.de] INFO: Scrape type for JY04435: 2
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-28 11:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6, identifier: JY04435
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-28 11:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435 to the API
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:00Z',
 'fuel_type': 'diesel',
 'id': 'dd2b0f88-1c5e-585c-8b03-0fc35bb792b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY04435',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 74296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-11',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.de] INFO: Saving data for JY04435: {'auction_closing_time': 1774717020.0, 'created_time': 1773306973.136709, 'last_price_update_time': 1774695858.849527}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY04435') HTTP/1.1" 204 0
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 11:04:18 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.de] INFO: Scrape type for YJ23133: 2
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-28 11:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1778f9b5-1d04-5f33-aa04-973d57a1dde1, identifier: YJ23133
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-28 11:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133 to the API
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:51Z',
 'fuel_type': 'petrol',
 'id': '1778f9b5-1d04-5f33-aa04-973d57a1dde1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ23133',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 58565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2022}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.de] INFO: Saving data for YJ23133: {'auction_closing_time': 1774714611.0, 'created_time': 1774294148.388859, 'last_price_update_time': 1774695859.294568}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ23133') HTTP/1.1" 204 0
2026-03-28 11:04:19 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 11:04:19 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 11:04:19 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 11:04:19 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.de] INFO: Scrape type for SD67792: 2
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21316b4c-87d4-55ae-8e44-c6578ebbc316 with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21316b4c-87d4-55ae-8e44-c6578ebbc316 with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21316b4c-87d4-55ae-8e44-c6578ebbc316, identifier: SD67792
2026-03-28 11:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-28 11:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-28 11:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792 to the API
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:07:22Z',
 'fuel_type': 'petrol',
 'id': '21316b4c-87d4-55ae-8e44-c6578ebbc316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD67792',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 60280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-02',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2013}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.de] INFO: Saving data for SD67792: {'auction_closing_time': 1774714042.0, 'created_time': 1774608004.102277, 'last_price_update_time': 1774695859.855674}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD67792') HTTP/1.1" 204 0
2026-03-28 11:04:19 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.de] INFO: Scrape type for ET35150: 2
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e, identifier: ET35150
2026-03-28 11:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-28 11:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-28 11:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150 to the API
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:29Z',
 'fuel_type': 'diesel',
 'id': 'f1d8ca13-d359-5298-b3a1-bfe5fc64df8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET35150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2012}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.de] INFO: Saving data for ET35150: {'auction_closing_time': 1774715129.0, 'created_time': 1773306993.706408, 'last_price_update_time': 1774695860.363332}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET35150') HTTP/1.1" 204 0
2026-03-28 11:04:20 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.de] INFO: Scrape type for JW09174: 2
2026-03-28 11:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-28 11:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5, identifier: JW09174
2026-03-28 11:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-28 11:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-28 11:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174 to the API
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:25Z',
 'fuel_type': 'petrol',
 'id': '6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW09174',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 169299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-18',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.de] INFO: Saving data for JW09174: {'auction_closing_time': 1774714525.0, 'created_time': 1773303435.256022, 'last_price_update_time': 1774695860.831028}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW09174') HTTP/1.1" 204 0
2026-03-28 11:04:20 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 11:04:20 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 11:04:20 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.de] INFO: Scrape type for SA82608: 2
2026-03-28 11:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-28 11:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-28 11:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a09a46bf-24eb-5a77-8f2d-815a0973ddf4, identifier: SA82608
2026-03-28 11:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-28 11:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-28 11:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608 to the API
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:55:20Z',
 'fuel_type': 'petrol',
 'id': 'a09a46bf-24eb-5a77-8f2d-815a0973ddf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA82608',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 7544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2020}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.de] INFO: Saving data for SA82608: {'auction_closing_time': 1774716920.0, 'created_time': 1773660078.102642, 'last_price_update_time': 1774695861.446815}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA82608') HTTP/1.1" 204 0
2026-03-28 11:04:21 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 11:04:21 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:55 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9702 | hits on page: 40
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Scrape type for EH74831: 2
2026-03-28 11:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-28 11:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b14289ac-35be-5e00-b887-be57d524cb89, identifier: EH74831
2026-03-28 11:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-28 11:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-28 11:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831 to the API
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:57Z',
 'fuel_type': 'petrol',
 'id': 'b14289ac-35be-5e00-b887-be57d524cb89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH74831',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 79141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Saving data for EH74831: {'auction_closing_time': 1774713717.0, 'created_time': 1773775402.534964, 'last_price_update_time': 1774695895.580771}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH74831') HTTP/1.1" 204 0
2026-03-28 11:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Scrape type for DK31638: 2
2026-03-28 11:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-28 11:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164f7313-845f-5b9e-9e16-8353f2ea1d92, identifier: DK31638
2026-03-28 11:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-28 11:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-28 11:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638 to the API
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 468,
 'expiration_date': '2026-03-28T16:07:56Z',
 'fuel_type': 'petrol',
 'id': '164f7313-845f-5b9e-9e16-8353f2ea1d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK31638',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 86432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
 'transmission': 'automatic',
 'trim': 'HEMI SRT',
 'year': 2015}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Saving data for DK31638: {'auction_closing_time': 1774714076.0, 'created_time': 1774262901.066826, 'last_price_update_time': 1774695896.122048}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK31638') HTTP/1.1" 204 0
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Scrape type for CA50565: 2
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-28 11:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3, identifier: CA50565
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-28 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565 to the API
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:58Z',
 'fuel_type': 'diesel',
 'id': 'f8d0d78c-15a0-5605-ba10-d3a8eccac6c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA50565',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 135252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'automatic',
 'trim': 'Style blue 2WD',
 'year': 2018}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Saving data for CA50565: {'auction_closing_time': 1774713778.0, 'created_time': 1773774481.528063, 'last_price_update_time': 1774695896.563307}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA50565') HTTP/1.1" 204 0
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Scrape type for XR26970: 2
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-28 11:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27715857-0716-53a3-b808-ec5d7e777291, identifier: XR26970
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-28 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970 to the API
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:51:42Z',
 'fuel_type': 'diesel',
 'id': '27715857-0716-53a3-b808-ec5d7e777291',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR26970',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 119055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2015}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Saving data for XR26970: {'auction_closing_time': 1774716702.0, 'created_time': 1773307846.300018, 'last_price_update_time': 1774695897.008642}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR26970') HTTP/1.1" 204 0
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Scrape type for UE57150: 2
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-28 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53, identifier: UE57150
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150 to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'diesel',
 'id': '80e08f92-033f-5fd1-aa5d-b3fe5341ee53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE57150',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 97526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-20',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2018}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Saving data for UE57150: {'auction_closing_time': 1774714816.0, 'created_time': 1773305943.13069, 'last_price_update_time': 1774695897.421015}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE57150') HTTP/1.1" 204 0
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Scrape type for LT21646: 2
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-28 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3007820d-77db-5437-8080-c9a57e30c5f5, identifier: LT21646
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646 to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:30:05Z',
 'fuel_type': 'petrol',
 'id': '3007820d-77db-5437-8080-c9a57e30c5f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT21646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 87721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Saving data for LT21646: {'auction_closing_time': 1774715405.0, 'created_time': 1773427246.178547, 'last_price_update_time': 1774695897.844094}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT21646') HTTP/1.1" 204 0
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Scrape type for WP04220: 2
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-28 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9703eaa8-b882-5107-a900-21f7a1b3a10b, identifier: WP04220
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220 to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:07:00Z',
 'fuel_type': 'diesel',
 'id': '9703eaa8-b882-5107-a900-21f7a1b3a10b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP04220',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 132820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-15',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2018}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Saving data for WP04220: {'auction_closing_time': 1774714020.0, 'created_time': 1773305422.350433, 'last_price_update_time': 1774695898.24996}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP04220') HTTP/1.1" 204 0
2026-03-28 11:04:58 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Scrape type for HB50510: 2
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87059a7e-f606-5f61-8bbf-a97ea7b6f386, identifier: HB50510
2026-03-28 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-28 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510 to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:53Z',
 'fuel_type': 'petrol',
 'id': '87059a7e-f606-5f61-8bbf-a97ea7b6f386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB50510',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 125114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Sound BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Saving data for HB50510: {'auction_closing_time': 1774716053.0, 'created_time': 1774291665.779535, 'last_price_update_time': 1774695898.658131}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB50510') HTTP/1.1" 204 0
2026-03-28 11:04:58 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Scrape type for XP96351: 2
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9cf80c6-a632-5a26-a895-34b7bdf4fbab, identifier: XP96351
2026-03-28 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-28 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351 to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:12:28Z',
 'fuel_type': 'diesel',
 'id': 'f9cf80c6-a632-5a26-a895-34b7bdf4fbab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP96351',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 44045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Saving data for XP96351: {'auction_closing_time': 1774714348.0, 'created_time': 1773305084.289303, 'last_price_update_time': 1774695899.106331}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP96351') HTTP/1.1" 204 0
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Scrape type for EP38579: 2
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-28 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a468eef-e5e7-58be-b86c-eacf239dc4c7, identifier: EP38579
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579 to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '1a468eef-e5e7-58be-b86c-eacf239dc4c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP38579',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 223402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-08',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Saving data for EP38579: {'auction_closing_time': 1774714134.0, 'created_time': 1773400332.831506, 'last_price_update_time': 1774695899.642082}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP38579') HTTP/1.1" 204 0
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Scrape type for BJ60837: 2
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-28 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0, identifier: BJ60837
2026-03-28 11:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837 to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:48Z',
 'fuel_type': 'diesel',
 'id': '5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ60837',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 62875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-15',
 'seller_name': None,
 'title': 'Audi Q2 35 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Saving data for BJ60837: {'auction_closing_time': 1774716528.0, 'created_time': 1774293694.471829, 'last_price_update_time': 1774695900.089074}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ60837') HTTP/1.1" 204 0
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Scrape type for EJ54624: 2
2026-03-28 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-28 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8, identifier: EJ54624
2026-03-28 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-28 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-28 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624 to the API
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:19:14Z',
 'fuel_type': 'petrol',
 'id': '2a4c65b3-bb1f-5d43-b8bc-83043911ddc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ54624',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 234636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Saving data for EJ54624: {'auction_closing_time': 1774714754.0, 'created_time': 1773400702.080137, 'last_price_update_time': 1774695900.600244}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ54624') HTTP/1.1" 204 0
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Scrape type for VN95277: 2
2026-03-28 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-28 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde03c7a-e316-5370-8e1d-50c5ccd2f772, identifier: VN95277
2026-03-28 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-28 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-28 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277 to the API
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:52Z',
 'fuel_type': 'diesel',
 'id': 'dde03c7a-e316-5370-8e1d-50c5ccd2f772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN95277',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 252462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Saving data for VN95277: {'auction_closing_time': 1774716892.0, 'created_time': 1774262589.516157, 'last_price_update_time': 1774695901.065584}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN95277') HTTP/1.1" 204 0
2026-03-28 11:05:01 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Scrape type for TJ67594: 2
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eef27ea-db7d-5f8b-b6af-a18637003549, identifier: TJ67594
2026-03-28 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-28 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-28 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594 to the API
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:21:01Z',
 'fuel_type': 'petrol',
 'id': '6eef27ea-db7d-5f8b-b6af-a18637003549',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ67594',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 80681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Saving data for TJ67594: {'auction_closing_time': 1774714861.0, 'created_time': 1773859362.653042, 'last_price_update_time': 1774695901.536816}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ67594') HTTP/1.1" 204 0
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Scrape type for VX34650: 2
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31049a8e-cdb3-51f8-a255-82f089ad50a9, identifier: VX34650
2026-03-28 11:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Scrape type for YN35790: 2
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3, identifier: YN35790
2026-03-28 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-28 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-28 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650 to the API
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:58:49Z',
 'fuel_type': 'petrol',
 'id': '31049a8e-cdb3-51f8-a255-82f089ad50a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX34650',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 151728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Saving data for VX34650: {'auction_closing_time': 1774717129.0, 'created_time': 1773774705.884662, 'last_price_update_time': 1774695902.078777}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX34650') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-28 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790 to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:42:54Z',
 'fuel_type': 'petrol',
 'id': 'de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN35790',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 38915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-21',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Saving data for YN35790: {'auction_closing_time': 1774716174.0, 'created_time': 1774265118.820482, 'last_price_update_time': 1774695902.485056}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN35790') HTTP/1.1" 204 0
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Scrape type for XM89515: 2
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-28 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445, identifier: XM89515
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Scrape type for DW90276: 2
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-28 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9cb8f80-896c-555d-a79d-028ef21c50ef, identifier: DW90276
2026-03-28 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-28 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515 to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:04:20Z',
 'fuel_type': 'petrol',
 'id': '671bb7d8-37ac-5a8b-ada1-dd7db8bf6445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM89515',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 109059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-15',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 Praktik',
 'transmission': 'manual',
 'trim': 'Praktik',
 'year': 2012}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Saving data for XM89515: {'auction_closing_time': 1774713860.0, 'created_time': 1774293880.955878, 'last_price_update_time': 1774695903.055447}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM89515') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-28 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-28 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276 to the API
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:09:35Z',
 'fuel_type': 'diesel',
 'id': 'd9cb8f80-896c-555d-a79d-028ef21c50ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW90276',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 120718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Multivan Generation Six 4Motion',
 'year': 2017}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Saving data for DW90276: {'auction_closing_time': 1774714175.0, 'created_time': 1773858928.621445, 'last_price_update_time': 1774695903.387083}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW90276') HTTP/1.1" 204 0
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Scrape type for DW00961: 2
2026-03-28 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-28 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c01bdfc6-e73c-5106-9ad7-4c5c2598782f, identifier: DW00961
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Scrape type for CF02627: 2
2026-03-28 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-28 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d777cb51-be22-582a-8544-509ff2400f61, identifier: CF02627
2026-03-28 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-28 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-28 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961 to the API
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:07:10Z',
 'fuel_type': 'diesel',
 'id': 'c01bdfc6-e73c-5106-9ad7-4c5c2598782f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW00961',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 193916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 340 L2 Trend',
 'transmission': 'manual',
 'trim': '340 L2 Trend',
 'year': 2016}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Saving data for DW00961: {'auction_closing_time': 1774714030.0, 'created_time': 1773138584.560725, 'last_price_update_time': 1774695903.992965}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW00961') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-28 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-28 11:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627 to the API
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:51:15Z',
 'fuel_type': 'petrol',
 'id': 'd777cb51-be22-582a-8544-509ff2400f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF02627',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 71198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Saving data for CF02627: {'auction_closing_time': 1774716675.0, 'created_time': 1773859653.438261, 'last_price_update_time': 1774695904.512067}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF02627') HTTP/1.1" 204 0
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Scrape type for DU27539: 2
2026-03-28 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-28 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4869be33-a847-5ca2-b107-350924eb03cf, identifier: DU27539
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Scrape type for SR77795: 2
2026-03-28 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-28 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7518fbbd-4d69-5c89-9ef8-db9b44759098, identifier: SR77795
2026-03-28 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-28 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-28 11:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539 to the API
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:48:45Z',
 'fuel_type': 'petrol',
 'id': '4869be33-a847-5ca2-b107-350924eb03cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU27539',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 143512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Saving data for DU27539: {'auction_closing_time': 1774716525.0, 'created_time': 1773860070.767056, 'last_price_update_time': 1774695905.260966}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU27539') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-28 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-28 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795 to the API
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:22:29Z',
 'fuel_type': 'diesel',
 'id': '7518fbbd-4d69-5c89-9ef8-db9b44759098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR77795',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 104063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Vignale 4x4',
 'transmission': 'automatic',
 'trim': 'Vignale 4x4',
 'year': 2017}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Saving data for SR77795: {'auction_closing_time': 1774714949.0, 'created_time': 1773467835.394671, 'last_price_update_time': 1774695905.644178}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR77795') HTTP/1.1" 204 0
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Scrape type for MC22222: 2
2026-03-28 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-28 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdfd7a21-c40a-50cb-a4a4-af9de3993814, identifier: MC22222
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Scrape type for BS26605: 2
2026-03-28 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-28 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf, identifier: BS26605
2026-03-28 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-28 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-28 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222 to the API
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:18Z',
 'fuel_type': 'petrol',
 'id': 'bdfd7a21-c40a-50cb-a4a4-af9de3993814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC22222',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 118272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Saving data for MC22222: {'auction_closing_time': 1774716438.0, 'created_time': 1773830931.305584, 'last_price_update_time': 1774695906.342642}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC22222') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-28 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-28 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605 to the API
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:21:07Z',
 'fuel_type': 'diesel',
 'id': '341d79e4-ad46-5a01-9a2a-a1d12f14feaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS26605',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 219300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Saving data for BS26605: {'auction_closing_time': 1774714867.0, 'created_time': 1773776013.509787, 'last_price_update_time': 1774695906.815255}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS26605') HTTP/1.1" 204 0
2026-03-28 11:05:06 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Scrape type for KF91285: 2
2026-03-28 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-28 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fdc03d9-bc57-5b61-b085-bce43f022bc9, identifier: KF91285
2026-03-28 11:05:06 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Scrape type for NV13181: 2
2026-03-28 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-28 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce, identifier: NV13181
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-28 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285 to the API
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:57:12Z',
 'fuel_type': 'petrol',
 'id': '4fdc03d9-bc57-5b61-b085-bce43f022bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF91285',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 103954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-29',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Saving data for KF91285: {'auction_closing_time': 1774717032.0, 'created_time': 1773305079.028194, 'last_price_update_time': 1774695907.412783}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF91285') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-28 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181 to the API
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'diesel',
 'id': 'ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV13181',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 276650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-16',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Saving data for NV13181: {'auction_closing_time': 1774714152.0, 'created_time': 1773427331.912878, 'last_price_update_time': 1774695907.752856}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV13181') HTTP/1.1" 204 0
2026-03-28 11:05:07 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Scrape type for WV94095: 2
2026-03-28 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-28 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab, identifier: WV94095
2026-03-28 11:05:07 [scrapy.extensions.logstats] INFO: Crawled 424 pages (at 3 pages/min), scraped 650 items (at 55 items/min)
2026-03-28 11:05:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:05:07 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Scrape type for EC25925: 2
2026-03-28 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-28 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc08f6bf-99be-56e5-8859-cccfd5d12af2, identifier: EC25925
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095 to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:53Z',
 'fuel_type': 'petrol',
 'id': 'db2cbad4-ee18-5f98-a0d5-7517cdb3eaab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV94095',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 142113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Saving data for WV94095: {'auction_closing_time': 1774716533.0, 'created_time': 1773741463.06113, 'last_price_update_time': 1774695908.275206}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV94095') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-28 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925 to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:30:04Z',
 'fuel_type': 'petrol',
 'id': 'bc08f6bf-99be-56e5-8859-cccfd5d12af2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC25925',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 199499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-29',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Saving data for EC25925: {'auction_closing_time': 1774715404.0, 'created_time': 1773466619.58683, 'last_price_update_time': 1774695908.594646}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC25925') HTTP/1.1" 204 0
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Scrape type for RB77182: 2
2026-03-28 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-28 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-28 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6203c47-d9c1-55ca-9f5c-077d71936cc6, identifier: RB77182
2026-03-28 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-28 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182 to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:05:53Z',
 'fuel_type': 'petrol',
 'id': 'd6203c47-d9c1-55ca-9f5c-077d71936cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB77182',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 57286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI N-Line 2WD',
 'transmission': 'automatic',
 'trim': 'N-Line 2WD',
 'year': 2020}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Saving data for RB77182: {'auction_closing_time': 1774713953.0, 'created_time': 1773657801.925021, 'last_price_update_time': 1774695909.021878}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB77182') HTTP/1.1" 204 0
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Scrape type for TV17454: 2
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-28 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b7f275c-e2d2-5b70-990e-661f91471912, identifier: TV17454
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454 to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:19Z',
 'fuel_type': 'diesel',
 'id': '2b7f275c-e2d2-5b70-990e-661f91471912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV17454',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 151607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Saving data for TV17454: {'auction_closing_time': 1774713679.0, 'created_time': 1773859615.92452, 'last_price_update_time': 1774695909.478922}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV17454') HTTP/1.1" 204 0
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Scrape type for JU77482: 2
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-28 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e161abf6-cd02-5201-91ff-e46bf75b50fc, identifier: JU77482
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482 to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:12:23Z',
 'fuel_type': 'diesel',
 'id': 'e161abf6-cd02-5201-91ff-e46bf75b50fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU77482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 159669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Saving data for JU77482: {'auction_closing_time': 1774714343.0, 'created_time': 1773426768.002692, 'last_price_update_time': 1774695909.938035}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU77482') HTTP/1.1" 204 0
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Scrape type for NX68514: 2
2026-03-28 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-28 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08303f5a-9d5c-54bd-868a-4b73e8e897c7, identifier: NX68514
2026-03-28 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-28 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-28 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514 to the API
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:59:56Z',
 'fuel_type': 'petrol',
 'id': '08303f5a-9d5c-54bd-868a-4b73e8e897c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68514',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 50454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Saving data for NX68514: {'auction_closing_time': 1774717196.0, 'created_time': 1774294279.71042, 'last_price_update_time': 1774695910.468881}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68514') HTTP/1.1" 204 0
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Scrape type for BV74864: 2
2026-03-28 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-28 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb87bf96-be5c-55dd-b193-8dc350e0f09d, identifier: BV74864
2026-03-28 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-28 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-28 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864 to the API
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:27:52Z',
 'fuel_type': 'petrol',
 'id': 'eb87bf96-be5c-55dd-b193-8dc350e0f09d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV74864',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 103859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-28',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Saving data for BV74864: {'auction_closing_time': 1774715272.0, 'created_time': 1773775791.75517, 'last_price_update_time': 1774695910.933022}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV74864') HTTP/1.1" 204 0
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Scrape type for TU33144: 2
2026-03-28 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-28 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a379f190-5340-5001-af2d-eb7bbbaf28b0, identifier: TU33144
2026-03-28 11:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-28 11:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-28 11:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144 to the API
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:11:35Z',
 'fuel_type': 'petrol',
 'id': 'a379f190-5340-5001-af2d-eb7bbbaf28b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU33144',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 93455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [auto1.de] INFO: Saving data for TU33144: {'auction_closing_time': 1774714295.0, 'created_time': 1773774326.429819, 'last_price_update_time': 1774695911.621478}
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU33144') HTTP/1.1" 204 0
2026-03-28 11:05:11 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 11:05:11 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 11:05:11 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 11:05:11 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [auto1.de] INFO: Scrape type for CW96119: 2
2026-03-28 11:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-28 11:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d0a061-043a-5bef-af38-b3a308bb1e86, identifier: CW96119
2026-03-28 11:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-28 11:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-28 11:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119 to the API
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:35Z',
 'fuel_type': 'petrol',
 'id': '66d0a061-043a-5bef-af38-b3a308bb1e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW96119',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 124543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-28 11:05:12 [auto1.de] INFO: Saving data for CW96119: {'auction_closing_time': 1774715255.0, 'created_time': 1773860967.140001, 'last_price_update_time': 1774695912.353547}
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW96119') HTTP/1.1" 204 0
2026-03-28 11:05:12 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 11:05:12 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-28 11:05:12 [auto1.de] INFO: Scrape type for YN77653: 2
2026-03-28 11:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-28 11:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-28 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-28 11:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55, identifier: YN77653
2026-03-28 11:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-28 11:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-28 11:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653 to the API
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:34:13Z',
 'fuel_type': 'petrol',
 'id': '4d58a9c3-eb96-5374-bd3a-e25ea28cbe55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN77653',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 115894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop',
 'transmission': 'manual',
 'trim': 'Active Start/Stop',
 'year': 2017}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Saving data for YN77653: {'auction_closing_time': 1774715653.0, 'created_time': 1774292602.629372, 'last_price_update_time': 1774695913.08557}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN77653') HTTP/1.1" 204 0
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-28 11:05:13 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Scrape type for ZV84359: 2
2026-03-28 11:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-28 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef68b548-af9a-5cd2-bb4e-0c0fb178d817, identifier: ZV84359
2026-03-28 11:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-28 11:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-28 11:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359 to the API
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:43:47Z',
 'fuel_type': 'diesel',
 'id': 'ef68b548-af9a-5cd2-bb4e-0c0fb178d817',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV84359',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 156647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-03',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Saving data for ZV84359: {'auction_closing_time': 1774716227.0, 'created_time': 1773426853.951205, 'last_price_update_time': 1774695913.819019}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV84359') HTTP/1.1" 204 0
2026-03-28 11:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Scrape type for ZL15649: 2
2026-03-28 11:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-28 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20, identifier: ZL15649
2026-03-28 11:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-28 11:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-28 11:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649 to the API
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:21:52Z',
 'fuel_type': 'diesel',
 'id': 'ab86ac41-15e4-5a0a-95d5-ebcacf93ad20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15649',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 158866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2019}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Saving data for ZL15649: {'auction_closing_time': 1774714912.0, 'created_time': 1774608062.530867, 'last_price_update_time': 1774695914.402347}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL15649') HTTP/1.1" 204 0
2026-03-28 11:05:14 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Scrape type for VX13516: 2
2026-03-28 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-28 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d, identifier: VX13516
2026-03-28 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-28 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-28 11:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516 to the API
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:50:11Z',
 'fuel_type': 'diesel',
 'id': '0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX13516',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 276282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-05',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Saving data for VX13516: {'auction_closing_time': 1774716611.0, 'created_time': 1773399936.200992, 'last_price_update_time': 1774695915.029911}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX13516') HTTP/1.1" 204 0
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Scrape type for JL65692: 2
2026-03-28 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-28 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b602d74-654e-532b-9eea-20ed15e62c97 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b602d74-654e-532b-9eea-20ed15e62c97 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b602d74-654e-532b-9eea-20ed15e62c97, identifier: JL65692
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:41:34Z',
 'fuel_type': 'petrol',
 'id': '1b602d74-654e-532b-9eea-20ed15e62c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL65692',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 82227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Saving data for JL65692: {'auction_closing_time': 1774716094.0, 'created_time': 1774608023.403767, 'last_price_update_time': 1774695915.645196}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL65692') HTTP/1.1" 204 0
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Scrape type for GA75258: 2
2026-03-28 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-28 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998148ad-7c7b-5486-a016-cfb485d2dfb2, identifier: GA75258
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:53:06Z',
 'fuel_type': 'diesel',
 'id': '998148ad-7c7b-5486-a016-cfb485d2dfb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA75258',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 197356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Saving data for GA75258: {'auction_closing_time': 1774716786.0, 'created_time': 1773400145.309242, 'last_price_update_time': 1774695916.212977}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA75258') HTTP/1.1" 204 0
2026-03-28 11:05:16 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Scrape type for EX10887: 2
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-28 11:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e, identifier: EX10887
2026-03-28 11:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-28 11:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-28 11:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887 to the API
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:39:38Z',
 'fuel_type': 'petrol',
 'id': 'b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX10887',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 107827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Saving data for EX10887: {'auction_closing_time': 1774715978.0, 'created_time': 1774293030.567528, 'last_price_update_time': 1774695916.671844}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX10887') HTTP/1.1" 204 0
2026-03-28 11:05:16 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Scrape type for WT60095: 2
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-28 11:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97042aa8-c767-5d71-8a41-28072e248773, identifier: WT60095
2026-03-28 11:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-28 11:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-28 11:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095 to the API
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:45:11Z',
 'fuel_type': 'diesel',
 'id': '97042aa8-c767-5d71-8a41-28072e248773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT60095',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 188024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2018}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Saving data for WT60095: {'auction_closing_time': 1774716311.0, 'created_time': 1773687135.837734, 'last_price_update_time': 1774695917.139374}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT60095') HTTP/1.1" 204 0
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Scrape type for HS53864: 2
2026-03-28 11:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-28 11:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb, identifier: HS53864
2026-03-28 11:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-28 11:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-28 11:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864 to the API
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:18Z',
 'fuel_type': 'diesel',
 'id': '096f9ff6-ff5e-5368-9de9-59b8ac2c74cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS53864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 190005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Saving data for HS53864: {'auction_closing_time': 1774716078.0, 'created_time': 1773858670.207965, 'last_price_update_time': 1774695917.685799}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS53864') HTTP/1.1" 204 0
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Scrape type for AH97983: 2
2026-03-28 11:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-28 11:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951, identifier: AH97983
2026-03-28 11:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-28 11:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-28 11:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983 to the API
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:50Z',
 'fuel_type': 'diesel',
 'id': 'cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH97983',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 173774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Saving data for AH97983: {'auction_closing_time': 1774714730.0, 'created_time': 1773399961.892188, 'last_price_update_time': 1774695918.179988}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH97983') HTTP/1.1" 204 0
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Scrape type for ED00109: 2
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc, identifier: ED00109
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109 to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'petrol',
 'id': '14a4dcb9-cff4-59c3-8989-a8c9b3a007fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED00109',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 192858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Saving data for ED00109: {'auction_closing_time': 1774716509.0, 'created_time': 1774290787.179871, 'last_price_update_time': 1774695918.59839}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED00109') HTTP/1.1" 204 0
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Scrape type for TV77789: 2
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3b2d8a-c07b-500a-82c2-76f73d979cea with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3b2d8a-c07b-500a-82c2-76f73d979cea with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b3b2d8a-c07b-500a-82c2-76f73d979cea, identifier: TV77789
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789 to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:01:58Z',
 'fuel_type': 'petrol',
 'id': '8b3b2d8a-c07b-500a-82c2-76f73d979cea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV77789',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 136930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-03',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.2 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2016}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Saving data for TV77789: {'auction_closing_time': 1774713718.0, 'created_time': 1774034338.163368, 'last_price_update_time': 1774695919.048639}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV77789') HTTP/1.1" 204 0
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Scrape type for XR43208: 2
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9988beee-091a-51a8-9251-c85e89b9b8ca, identifier: XR43208
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-28 11:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-28 11:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208 to the API
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:13:58Z',
 'fuel_type': 'diesel',
 'id': '9988beee-091a-51a8-9251-c85e89b9b8ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR43208',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 140190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Saving data for XR43208: {'auction_closing_time': 1774714438.0, 'created_time': 1774293312.589195, 'last_price_update_time': 1774695919.477496}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR43208') HTTP/1.1" 204 0
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Scrape type for KN65444: 2
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a209ed-c1ec-58e8-8243-fd471eaa4511, identifier: KN65444
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-28 11:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-28 11:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444 to the API
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-28T16:41:52Z',
 'fuel_type': 'hybrid',
 'id': 'a4a209ed-c1ec-58e8-8243-fd471eaa4511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN65444',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 47574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Saving data for KN65444: {'auction_closing_time': 1774716112.0, 'created_time': 1774290894.901808, 'last_price_update_time': 1774695919.923622}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN65444') HTTP/1.1" 204 0
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Scrape type for LK29782: 2
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d7e4c2-6335-5aa6-b768-99391cc6bd88, identifier: LK29782
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-28 11:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-28 11:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782 to the API
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:31:54Z',
 'fuel_type': 'petrol',
 'id': 'a4d7e4c2-6335-5aa6-b768-99391cc6bd88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK29782',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 23860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Saving data for LK29782: {'auction_closing_time': 1774715514.0, 'created_time': 1773427476.579495, 'last_price_update_time': 1774695920.368705}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK29782') HTTP/1.1" 204 0
2026-03-28 11:05:20 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Scrape type for SC70285: 2
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bb24ee4-37db-5074-9208-16d3d2d58feb, identifier: SC70285
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-28 11:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-28 11:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285 to the API
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:43Z',
 'fuel_type': 'diesel',
 'id': '3bb24ee4-37db-5074-9208-16d3d2d58feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC70285',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 273874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Saving data for SC70285: {'auction_closing_time': 1774716343.0, 'created_time': 1773137311.513845, 'last_price_update_time': 1774695920.86552}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC70285') HTTP/1.1" 204 0
2026-03-28 11:05:21 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Scrape type for CZ94450: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 023b43e7-00c1-5cae-8017-4b4155e5e661, identifier: CZ94450
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-28 11:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-28 11:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450 to the API
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:48Z',
 'fuel_type': 'petrol',
 'id': '023b43e7-00c1-5cae-8017-4b4155e5e661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ94450',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 147514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Saving data for CZ94450: {'auction_closing_time': 1774714488.0, 'created_time': 1774292019.43737, 'last_price_update_time': 1774695921.609744}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ94450') HTTP/1.1" 204 0
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Scrape type for ZE40568: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e, identifier: ZE40568
2026-03-28 11:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Scrape type for TF63689: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34194588-12f6-54d3-ae6f-f5170e716e17, identifier: TF63689
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-28 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568 to the API
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:29Z',
 'fuel_type': 'diesel',
 'id': '018a3c7a-e421-5e8e-8bdb-bfa78fd0594e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40568',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 189025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'BMW 3er 320d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2017}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Saving data for ZE40568: {'auction_closing_time': 1774716629.0, 'created_time': 1773399998.814952, 'last_price_update_time': 1774695922.351945}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE40568') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-28 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689 to the API
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:59:46Z',
 'fuel_type': 'petrol',
 'id': '34194588-12f6-54d3-ae6f-f5170e716e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF63689',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 147337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'BMW 3er 328i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Saving data for TF63689: {'auction_closing_time': 1774717186.0, 'created_time': 1774291997.535388, 'last_price_update_time': 1774695922.743404}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF63689') HTTP/1.1" 204 0
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Scrape type for FK97856: 2
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6e9f46-25bd-5649-84d0-89374332d38e, identifier: FK97856
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Scrape type for WW16724: 2
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94af90a-ffcb-5a07-9fd7-27f562bbce1b, identifier: WW16724
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:47:59Z',
 'fuel_type': 'petrol',
 'id': '4d6e9f46-25bd-5649-84d0-89374332d38e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK97856',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 102102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-23',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Saving data for FK97856: {'auction_closing_time': 1774716479.0, 'created_time': 1773772242.563258, 'last_price_update_time': 1774695923.382212}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK97856') HTTP/1.1" 204 0
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:26:48Z',
 'fuel_type': 'diesel',
 'id': 'f94af90a-ffcb-5a07-9fd7-27f562bbce1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW16724',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 199436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2017}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Saving data for WW16724: {'auction_closing_time': 1774715208.0, 'created_time': 1773819038.868884, 'last_price_update_time': 1774695923.708901}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW16724') HTTP/1.1" 204 0
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Scrape type for WE44185: 2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d, identifier: WE44185
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Scrape type for EB33579: 2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192ff80f-f22b-5e01-a34f-c6f43f215114, identifier: EB33579
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-28 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185 to the API
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:35:04Z',
 'fuel_type': 'petrol',
 'id': '1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE44185',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 88458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Saving data for WE44185: {'auction_closing_time': 1774715704.0, 'created_time': 1774290657.325942, 'last_price_update_time': 1774695924.31189}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE44185') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-28 11:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-28 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579 to the API
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:47:24Z',
 'fuel_type': 'diesel',
 'id': '192ff80f-f22b-5e01-a34f-c6f43f215114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB33579',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 93778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
 'transmission': 'automatic',
 'trim': 'Ocean FWD',
 'year': 2021}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Saving data for EB33579: {'auction_closing_time': 1774716444.0, 'created_time': 1773340378.96919, 'last_price_update_time': 1774695924.764283}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB33579') HTTP/1.1" 204 0
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Scrape type for NN66597: 2
2026-03-28 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-28 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9, identifier: NN66597
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Scrape type for DX68266: 2
2026-03-28 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-28 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd67f9c6-c7b9-5060-b0da-946d9bc75931, identifier: DX68266
2026-03-28 11:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-28 11:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-28 11:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597 to the API
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:48:36Z',
 'fuel_type': 'hybrid',
 'id': '5ab90b43-623e-5bc7-bea2-47c2de6cccc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN66597',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 106388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2021}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Saving data for NN66597: {'auction_closing_time': 1774716516.0, 'created_time': 1774264441.724794, 'last_price_update_time': 1774695925.366711}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN66597') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-28 11:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-28 11:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266 to the API
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-28T16:52:19Z',
 'fuel_type': 'diesel',
 'id': 'bd67f9c6-c7b9-5060-b0da-946d9bc75931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX68266',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 137524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L1H1 2,7t Expression',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Expression',
 'year': 2019}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Saving data for DX68266: {'auction_closing_time': 1774716739.0, 'created_time': 1774292886.596666, 'last_price_update_time': 1774695925.7979}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX68266') HTTP/1.1" 204 0
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Scrape type for XB90216: 2
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c44d5c4b-2c47-59f9-86f8-c1b4a6278683, identifier: XB90216
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Scrape type for TF26076: 2
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-28 11:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8283d1-3454-52ff-8ee7-13387781cc71, identifier: TF26076
2026-03-28 11:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-28 11:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-28 11:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216 to the API
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:45Z',
 'fuel_type': 'diesel',
 'id': 'c44d5c4b-2c47-59f9-86f8-c1b4a6278683',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB90216',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 110426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2015}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Saving data for XB90216: {'auction_closing_time': 1774713825.0, 'created_time': 1774291339.257916, 'last_price_update_time': 1774695926.523697}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB90216') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-28 11:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-28 11:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076 to the API
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:40:53Z',
 'fuel_type': 'hybrid',
 'id': '6b8283d1-3454-52ff-8ee7-13387781cc71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF26076',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 37301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Saving data for TF26076: {'auction_closing_time': 1774716053.0, 'created_time': 1773304061.515343, 'last_price_update_time': 1774695926.906962}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF26076') HTTP/1.1" 204 0
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Scrape type for LB47051: 2
2026-03-28 11:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-28 11:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc, identifier: LB47051
2026-03-28 11:05:27 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [auto1.de] INFO: Scrape type for TV60687: 2
2026-03-28 11:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-28 11:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3edd7c-0625-5490-8f7a-e716059083dd, identifier: TV60687
2026-03-28 11:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-28 11:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-28 11:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051 to the API
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:26Z',
 'fuel_type': 'diesel',
 'id': '8d5129b1-1119-5e66-a41a-6cc1cf6b93dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB47051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 350327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [auto1.de] INFO: Saving data for LB47051: {'auction_closing_time': 1774714586.0, 'created_time': 1774294582.005345, 'last_price_update_time': 1774695927.765325}
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB47051') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-28 11:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-28 11:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687 to the API
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:03Z',
 'fuel_type': 'petrol',
 'id': 'cc3edd7c-0625-5490-8f7a-e716059083dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV60687',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 149218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Saving data for TV60687: {'auction_closing_time': 1774713783.0, 'created_time': 1773685840.45106, 'last_price_update_time': 1774695928.358787}
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV60687') HTTP/1.1" 204 0
2026-03-28 11:05:28 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Scrape type for NR01003: 2
2026-03-28 11:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-28 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9becfd88-2267-5299-81e8-ce7fd5e06001, identifier: NR01003
2026-03-28 11:05:28 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Scrape type for KL29911: 2
2026-03-28 11:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-28 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8551cd-58a9-5767-88fd-643a920471c4 with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d8551cd-58a9-5767-88fd-643a920471c4 with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d8551cd-58a9-5767-88fd-643a920471c4, identifier: KL29911
2026-03-28 11:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-28 11:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-28 11:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003 to the API
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:16:26Z',
 'fuel_type': 'petrol',
 'id': '9becfd88-2267-5299-81e8-ce7fd5e06001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR01003',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 142017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'BMW 2er 216i Active Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Saving data for NR01003: {'auction_closing_time': 1774714586.0, 'created_time': 1773135853.206265, 'last_price_update_time': 1774695929.075543}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR01003') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-28 11:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-28 11:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911 to the API
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:46:44Z',
 'fuel_type': 'diesel',
 'id': '2d8551cd-58a9-5767-88fd-643a920471c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL29911',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 60565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Saving data for KL29911: {'auction_closing_time': 1774716404.0, 'created_time': 1774608055.967395, 'last_price_update_time': 1774695929.564664}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL29911') HTTP/1.1" 204 0
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Scrape type for LL09257: 2
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-28 11:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e, identifier: LL09257
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Scrape type for TH70911: 2
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-28 11:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ecd3a4c-5a89-5958-bad3-68d67afded52 with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ecd3a4c-5a89-5958-bad3-68d67afded52 with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ecd3a4c-5a89-5958-bad3-68d67afded52, identifier: TH70911
2026-03-28 11:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-28 11:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:05:43Z',
 'fuel_type': 'petrol',
 'id': 'c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL09257',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 44520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Saving data for LL09257: {'auction_closing_time': 1774713943.0, 'created_time': 1773427808.751477, 'last_price_update_time': 1774695930.255865}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL09257') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:24Z',
 'fuel_type': 'diesel',
 'id': '3ecd3a4c-5a89-5958-bad3-68d67afded52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH70911',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 181201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Saving data for TH70911: {'auction_closing_time': 1774716024.0, 'created_time': 1773426820.669321, 'last_price_update_time': 1774695930.656236}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH70911') HTTP/1.1" 204 0
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Scrape type for AR53020: 2
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-28 11:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32dbe053-06ff-56fa-aa4b-843394f9b659, identifier: AR53020
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Scrape type for CK84203: 2
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-28 11:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93a00916-98b5-5ed9-92af-a78295bc84fc with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93a00916-98b5-5ed9-92af-a78295bc84fc with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93a00916-98b5-5ed9-92af-a78295bc84fc, identifier: CK84203
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-28 11:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020 to the API
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:35:35Z',
 'fuel_type': 'diesel',
 'id': '32dbe053-06ff-56fa-aa4b-843394f9b659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR53020',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 127760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-22',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Saving data for AR53020: {'auction_closing_time': 1774715735.0, 'created_time': 1773427561.411427, 'last_price_update_time': 1774695932.188819}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR53020') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-28 11:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-28 11:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203 to the API
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:44Z',
 'fuel_type': 'petrol',
 'id': '93a00916-98b5-5ed9-92af-a78295bc84fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK84203',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 227605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-29',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Saving data for CK84203: {'auction_closing_time': 1774716284.0, 'created_time': 1774608048.970035, 'last_price_update_time': 1774695932.529204}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK84203') HTTP/1.1" 204 0
2026-03-28 11:05:32 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 11:05:32 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Scrape type for SA06109: 2
2026-03-28 11:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-28 11:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-28 11:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 698628e7-16f0-58dc-a7c7-d9cd3790794b, identifier: SA06109
2026-03-28 11:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-28 11:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-28 11:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109 to the API
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:37:06Z',
 'fuel_type': 'diesel',
 'id': '698628e7-16f0-58dc-a7c7-d9cd3790794b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA06109',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 180130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Saving data for SA06109: {'auction_closing_time': 1774715826.0, 'created_time': 1773379830.726534, 'last_price_update_time': 1774695933.151209}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA06109') HTTP/1.1" 204 0
2026-03-28 11:05:33 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Scrape type for AE21884: 2
2026-03-28 11:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-28 11:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0250675-1b3d-5f97-92c7-d60ee3082ece, identifier: AE21884
2026-03-28 11:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-28 11:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:49Z',
 'fuel_type': 'diesel',
 'id': 'c0250675-1b3d-5f97-92c7-d60ee3082ece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE21884',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 182888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Saving data for AE21884: {'auction_closing_time': 1774714129.0, 'created_time': 1773304264.800252, 'last_price_update_time': 1774695933.606972}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE21884') HTTP/1.1" 204 0
2026-03-28 11:05:33 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Scrape type for SZ48596: 2
2026-03-28 11:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-28 11:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1, identifier: SZ48596
2026-03-28 11:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-28 11:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:49Z',
 'fuel_type': 'diesel',
 'id': '8aca3659-3eeb-5cbe-bc35-caa6efafbfc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ48596',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 118336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Cruise FWD',
 'transmission': 'automatic',
 'trim': 'Cruise FWD',
 'year': 2020}
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [auto1.de] INFO: Saving data for SZ48596: {'auction_closing_time': 1774716289.0, 'created_time': 1773304168.733015, 'last_price_update_time': 1774695934.058849}
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ48596') HTTP/1.1" 204 0
2026-03-28 11:05:34 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-28 11:05:34 [auto1.de] INFO: Scrape type for YH85992: 2
2026-03-28 11:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-28 11:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-28 11:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039e5412-a506-5aa4-9a84-a640663eb484, identifier: YH85992
2026-03-28 11:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-28 11:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-28 11:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992 to the API
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:16:32Z',
 'fuel_type': 'diesel',
 'id': '039e5412-a506-5aa4-9a84-a640663eb484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH85992',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 217653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Saving data for YH85992: {'auction_closing_time': 1774714592.0, 'created_time': 1773858652.811359, 'last_price_update_time': 1774695935.229292}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH85992') HTTP/1.1" 204 0
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Scrape type for EC33073: 2
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-28 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daac7975-829c-5726-8424-3d07b3a3d396, identifier: EC33073
2026-03-28 11:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-28 11:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-28 11:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073 to the API
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:54:43Z',
 'fuel_type': 'petrol',
 'id': 'daac7975-829c-5726-8424-3d07b3a3d396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 68450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Saving data for EC33073: {'auction_closing_time': 1774716883.0, 'created_time': 1774293756.55904, 'last_price_update_time': 1774695935.678916}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33073') HTTP/1.1" 204 0
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Scrape type for LR06917: 2
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-28 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a761a09-404b-5f6d-973f-a77d7fd03a97, identifier: LR06917
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-28 11:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-28 11:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917 to the API
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:20:19Z',
 'fuel_type': 'diesel',
 'id': '3a761a09-404b-5f6d-973f-a77d7fd03a97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR06917',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 247027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Saving data for LR06917: {'auction_closing_time': 1774714819.0, 'created_time': 1773859875.735783, 'last_price_update_time': 1774695936.22498}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR06917') HTTP/1.1" 204 0
2026-03-28 11:05:36 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Scrape type for CR11100: 2
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd1872c-6273-5317-b4bf-3c69666c1e1a, identifier: CR11100
2026-03-28 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-28 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-28 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100 to the API
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:59:09Z',
 'fuel_type': 'diesel',
 'id': '1fd1872c-6273-5317-b4bf-3c69666c1e1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR11100',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 222827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2016}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Saving data for CR11100: {'auction_closing_time': 1774717149.0, 'created_time': 1773303513.283578, 'last_price_update_time': 1774695936.803047}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR11100') HTTP/1.1" 204 0
2026-03-28 11:05:36 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Scrape type for NY09817: 2
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4, identifier: NY09817
2026-03-28 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-28 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-28 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817 to the API
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:10:03Z',
 'fuel_type': 'petrol',
 'id': '957d5b54-b9d7-5f17-9a31-2ece5d6101a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY09817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 167683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Carat BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion',
 'year': 2018}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Saving data for NY09817: {'auction_closing_time': 1774714203.0, 'created_time': 1774608037.358498, 'last_price_update_time': 1774695937.270708}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY09817') HTTP/1.1" 204 0
2026-03-28 11:05:37 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Scrape type for SL47086: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62fd87bc-91b6-5aac-adba-619880342280, identifier: SL47086
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-28 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-28 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086 to the API
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:07Z',
 'fuel_type': 'diesel',
 'id': '62fd87bc-91b6-5aac-adba-619880342280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL47086',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 59333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2022}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Saving data for SL47086: {'auction_closing_time': 1774717087.0, 'created_time': 1773859232.539409, 'last_price_update_time': 1774695937.729376}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL47086') HTTP/1.1" 204 0
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Scrape type for ND33880: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95012aec-382b-5018-b1d7-3351a4df06d2, identifier: ND33880
2026-03-28 11:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Scrape type for VN06043: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d, identifier: VN06043
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-28 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880 to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'petrol',
 'id': '95012aec-382b-5018-b1d7-3351a4df06d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND33880',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 133798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Saving data for ND33880: {'auction_closing_time': 1774716347.0, 'created_time': 1773687628.022583, 'last_price_update_time': 1774695938.318563}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND33880') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043 to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:12:47Z',
 'fuel_type': 'diesel',
 'id': '7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN06043',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 63125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Saving data for VN06043: {'auction_closing_time': 1774714367.0, 'created_time': 1773136038.289438, 'last_price_update_time': 1774695938.638947}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN06043') HTTP/1.1" 204 0
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Scrape type for TU29288: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e, identifier: TU29288
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Scrape type for EB01944: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1, identifier: EB01944
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288 to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:58:38Z',
 'fuel_type': 'hybrid',
 'id': '11cc4c26-e79f-5114-b6e8-e2fd37b6918e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU29288',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 52168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SE Essential Trim ALL4',
 'transmission': 'automatic',
 'trim': 'Essential Trim ALL4',
 'year': 2022}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Saving data for TU29288: {'auction_closing_time': 1774717118.0, 'created_time': 1773306982.261137, 'last_price_update_time': 1774695939.274698}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU29288') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944 to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:41:52Z',
 'fuel_type': 'petrol',
 'id': 'ebe88af6-9a60-5dfe-a689-4ef75fbf16e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB01944',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 87327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-13',
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Saving data for EB01944: {'auction_closing_time': 1774716112.0, 'created_time': 1773136467.123687, 'last_price_update_time': 1774695939.706665}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB01944') HTTP/1.1" 204 0
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Scrape type for EZ94089: 2
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba, identifier: EZ94089
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Scrape type for TF52264: 2
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4428ba84-f3e1-5194-bd76-54dfe1495501, identifier: TF52264
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-28 11:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089 to the API
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:25:20Z',
 'fuel_type': 'petrol',
 'id': '99c0cb98-7ff4-5e36-812b-ef5d45be10ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ94089',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 103194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-21',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Saving data for EZ94089: {'auction_closing_time': 1774715120.0, 'created_time': 1774349363.88541, 'last_price_update_time': 1774695941.363149}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ94089') HTTP/1.1" 204 0
2026-03-28 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-28 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-28 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264 to the API
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:22:27Z',
 'fuel_type': 'diesel',
 'id': '4428ba84-f3e1-5194-bd76-54dfe1495501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF52264',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 150948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Saving data for TF52264: {'auction_closing_time': 1774714947.0, 'created_time': 1773400604.75493, 'last_price_update_time': 1774695941.781889}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF52264') HTTP/1.1" 204 0
2026-03-28 11:05:41 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Scrape type for YT04304: 2
2026-03-28 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-28 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 014c542a-9e88-59b8-83a5-bf76c553ee3e, identifier: YT04304
2026-03-28 11:05:41 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 11:05:41 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 11:05:41 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Scrape type for TY82930: 2
2026-03-28 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-28 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de1ce19-0924-50d8-bbd5-650c94288ed5, identifier: TY82930
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304 to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:44Z',
 'fuel_type': 'diesel',
 'id': '014c542a-9e88-59b8-83a5-bf76c553ee3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT04304',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Saving data for YT04304: {'auction_closing_time': 1774715864.0, 'created_time': 1773304367.687804, 'last_price_update_time': 1774695942.3849}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT04304') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930 to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-28T16:37:46Z',
 'fuel_type': 'petrol',
 'id': '2de1ce19-0924-50d8-bbd5-650c94288ed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY82930',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 107220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Saving data for TY82930: {'auction_closing_time': 1774715866.0, 'created_time': 1773658612.037912, 'last_price_update_time': 1774695942.730117}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY82930') HTTP/1.1" 204 0
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Scrape type for CZ89661: 2
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 604475fb-0a77-588c-b7d4-a3667d135f58, identifier: CZ89661
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661 to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:13Z',
 'fuel_type': 'petrol',
 'id': '604475fb-0a77-588c-b7d4-a3667d135f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ89661',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 72383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-27',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 Selection Start/Stop',
 'transmission': 'manual',
 'trim': 'Selection Start/Stop',
 'year': 2016}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Saving data for CZ89661: {'auction_closing_time': 1774715593.0, 'created_time': 1773467350.095299, 'last_price_update_time': 1774695943.170789}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ89661') HTTP/1.1" 204 0
2026-03-28 11:05:43 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Scrape type for XN32134: 2
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d, identifier: XN32134
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134 to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:04Z',
 'fuel_type': 'petrol',
 'id': '40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN32134',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 55805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-27',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 LX 2WD',
 'transmission': 'manual',
 'trim': 'LX 2WD',
 'year': 2009}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Saving data for XN32134: {'auction_closing_time': 1774714204.0, 'created_time': 1774290706.952195, 'last_price_update_time': 1774695943.598673}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN32134') HTTP/1.1" 204 0
2026-03-28 11:05:43 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Scrape type for ZS84546: 2
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14936224-b559-5c51-b0ee-14f74714156d, identifier: ZS84546
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546 to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:15:18Z',
 'fuel_type': 'petrol',
 'id': '14936224-b559-5c51-b0ee-14f74714156d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS84546',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 64978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-14',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2014}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Saving data for ZS84546: {'auction_closing_time': 1774714518.0, 'created_time': 1773400086.235863, 'last_price_update_time': 1774695944.087474}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS84546') HTTP/1.1" 204 0
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Scrape type for SH26484: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e, identifier: SH26484
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484 to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:15Z',
 'fuel_type': 'petrol',
 'id': '9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH26484',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 152397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Soleil',
 'transmission': 'automatic',
 'trim': 'Soleil',
 'year': 2020}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Saving data for SH26484: {'auction_closing_time': 1774715535.0, 'created_time': 1773819034.431577, 'last_price_update_time': 1774695944.615143}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH26484') HTTP/1.1" 204 0
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Scrape type for DJ32425: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c10d3bf-c14a-570c-90e4-6d0c55c32190, identifier: DJ32425
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425 to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '9c10d3bf-c14a-570c-90e4-6d0c55c32190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ32425',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 70834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2016}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Saving data for DJ32425: {'auction_closing_time': 1774717108.0, 'created_time': 1773307966.870438, 'last_price_update_time': 1774695945.065647}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ32425') HTTP/1.1" 204 0
2026-03-28 11:05:45 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 11:05:45 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Scrape type for HX34455: 2
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d65715d4-7f34-5a8b-bd13-a89dca28c524, identifier: HX34455
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:59Z',
 'fuel_type': 'diesel',
 'id': 'd65715d4-7f34-5a8b-bd13-a89dca28c524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX34455',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 111597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Saving data for HX34455: {'auction_closing_time': 1774716359.0, 'created_time': 1773306638.925378, 'last_price_update_time': 1774695945.523061}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX34455') HTTP/1.1" 204 0
2026-03-28 11:05:45 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Scrape type for DV91076: 2
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72, identifier: DV91076
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-28T16:50:10Z',
 'fuel_type': 'diesel',
 'id': '88cfcf40-1c29-5e06-8e86-0f4abc0fed72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV91076',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 297655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-31',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Turbodiesel EX 4WD',
 'transmission': 'automatic',
 'trim': 'EX 4WD',
 'year': 2005}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Saving data for DV91076: {'auction_closing_time': 1774716610.0, 'created_time': 1773468474.634517, 'last_price_update_time': 1774695946.022849}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV91076') HTTP/1.1" 204 0
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Scrape type for ZU26768: 2
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b40f711-92ae-5045-adcb-71839f045d3d, identifier: ZU26768
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768 to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:29:37Z',
 'fuel_type': 'diesel',
 'id': '3b40f711-92ae-5045-adcb-71839f045d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU26768',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 294305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2006}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Saving data for ZU26768: {'auction_closing_time': 1774715377.0, 'created_time': 1774118856.095716, 'last_price_update_time': 1774695946.494206}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU26768') HTTP/1.1" 204 0
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Scrape type for RX21062: 2
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82272a7b-f8a4-55f4-9661-187b7c878674, identifier: RX21062
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062 to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-28T16:07:29Z',
 'fuel_type': 'petrol',
 'id': '82272a7b-f8a4-55f4-9661-187b7c878674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21062',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 9140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Edition '
          'Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Edition Avantgarde',
 'year': 2025}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Saving data for RX21062: {'auction_closing_time': 1774714049.0, 'created_time': 1773773459.754662, 'last_price_update_time': 1774695946.943297}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21062') HTTP/1.1" 204 0
2026-03-28 11:05:47 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Scrape type for GU43225: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58, identifier: GU43225
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225 to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:56Z',
 'fuel_type': 'diesel',
 'id': '6746d2a1-de9d-5b45-a9f4-cae3dd508e58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU43225',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 342306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Saving data for GU43225: {'auction_closing_time': 1774716056.0, 'created_time': 1773303802.705745, 'last_price_update_time': 1774695947.512438}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU43225') HTTP/1.1" 204 0
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Scrape type for YM75197: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9eee2f6c-fa09-50f9-9efa-589af2df66c7, identifier: YM75197
2026-03-28 11:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Scrape type for FD07804: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dc9a63b-bef0-516a-b640-0ed70f5eb054, identifier: FD07804
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197 to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:48:44Z',
 'fuel_type': 'hybrid',
 'id': '9eee2f6c-fa09-50f9-9efa-589af2df66c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM75197',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 106950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Saving data for YM75197: {'auction_closing_time': 1774716524.0, 'created_time': 1774291964.290181, 'last_price_update_time': 1774695948.104503}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM75197') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-28 11:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804 to the API
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:49Z',
 'fuel_type': 'petrol',
 'id': '7dc9a63b-bef0-516a-b640-0ed70f5eb054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD07804',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 306605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Saving data for FD07804: {'auction_closing_time': 1774714489.0, 'created_time': 1774293941.83323, 'last_price_update_time': 1774695948.454518}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD07804') HTTP/1.1" 204 0
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Scrape type for XS50717: 2
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce99cba-2e69-5b5f-9d47-a22d9de18873, identifier: XS50717
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Scrape type for FC29722: 2
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79e52d5-7216-5b83-9ff0-2b2e8efb8266, identifier: FC29722
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-28 11:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717 to the API
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:02:15Z',
 'fuel_type': 'diesel',
 'id': '1ce99cba-2e69-5b5f-9d47-a22d9de18873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50717',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 186763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'BMW 3er 316d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Saving data for XS50717: {'auction_closing_time': 1774713735.0, 'created_time': 1774349102.194211, 'last_price_update_time': 1774695949.103383}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS50717') HTTP/1.1" 204 0
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722 to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-28T16:32:06Z',
 'fuel_type': 'petrol',
 'id': 'b79e52d5-7216-5b83-9ff0-2b2e8efb8266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC29722',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Nitro',
 'odometer': 126228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-06',
 'seller_name': None,
 'title': 'Dodge Nitro 4.0 V6 R/T',
 'transmission': 'automatic',
 'trim': 'R/T',
 'year': 2013}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Saving data for FC29722: {'auction_closing_time': 1774715526.0, 'created_time': 1773305217.884571, 'last_price_update_time': 1774695949.554019}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC29722') HTTP/1.1" 204 0
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for UL70410: 2
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8108484-dca2-5f28-a753-328ff9449450, identifier: UL70410
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for LG31115: 2
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c82f2fe-4503-53aa-8263-f7cdd614fda7, identifier: LG31115
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410 to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:31Z',
 'fuel_type': 'petrol',
 'id': 'd8108484-dca2-5f28-a753-328ff9449450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL70410',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 37200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-03',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Saving data for UL70410: {'auction_closing_time': 1774716451.0, 'created_time': 1773661899.48174, 'last_price_update_time': 1774695950.092704}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL70410') HTTP/1.1" 204 0
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:18:02Z',
 'fuel_type': 'petrol',
 'id': '4c82f2fe-4503-53aa-8263-f7cdd614fda7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG31115',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 139869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Saving data for LG31115: {'auction_closing_time': 1774714682.0, 'created_time': 1774292016.506207, 'last_price_update_time': 1774695950.413265}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG31115') HTTP/1.1" 204 0
2026-03-28 11:05:50 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 11:05:50 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Scrape type for KM66171: 2
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9bd72b3-bf31-54d5-8033-a5b253fd8afe, identifier: KM66171
2026-03-28 11:05:50 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Scrape type for NY75190: 2
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954, identifier: NY75190
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:41:46Z',
 'fuel_type': 'petrol',
 'id': 'e9bd72b3-bf31-54d5-8033-a5b253fd8afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM66171',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 93938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [auto1.de] INFO: Saving data for KM66171: {'auction_closing_time': 1774716106.0, 'created_time': 1773134586.161787, 'last_price_update_time': 1774695951.541959}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM66171') HTTP/1.1" 204 0
2026-03-28 11:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-28 11:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-28 11:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190 to the API
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:43Z',
 'fuel_type': 'petrol',
 'id': '936031d5-5b8a-5edc-b7a6-5f76a8f3d954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY75190',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 72999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [auto1.de] INFO: Saving data for NY75190: {'auction_closing_time': 1774714603.0, 'created_time': 1773469040.023094, 'last_price_update_time': 1774695951.963643}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY75190') HTTP/1.1" 204 0
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [auto1.de] INFO: Scrape type for TK73674: 2
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ae663c-824b-5662-b61d-990a1cdb9c99 with scrape type 2
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ae663c-824b-5662-b61d-990a1cdb9c99 with scrape type 2
2026-03-28 11:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ae663c-824b-5662-b61d-990a1cdb9c99, identifier: TK73674
2026-03-28 11:05:52 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [auto1.de] INFO: Scrape type for TB49418: 2
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-28 11:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b67c7ff8-120a-5144-ab8a-f43452b49b74, identifier: TB49418
2026-03-28 11:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-28 11:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-28 11:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674 to the API
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:07:23Z',
 'fuel_type': 'petrol',
 'id': '77ae663c-824b-5662-b61d-990a1cdb9c99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK73674',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 40850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2022}
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [auto1.de] INFO: Saving data for TK73674: {'auction_closing_time': 1774714043.0, 'created_time': 1773303465.612273, 'last_price_update_time': 1774695952.535373}
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK73674') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-28 11:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-28 11:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418 to the API
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:08:57Z',
 'fuel_type': 'petrol',
 'id': 'b67c7ff8-120a-5144-ab8a-f43452b49b74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB49418',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 113025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-27',
 'seller_name': None,
 'title': 'BMW 6er 645 CI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [auto1.de] INFO: Saving data for TB49418: {'auction_closing_time': 1774714137.0, 'created_time': 1773223597.423583, 'last_price_update_time': 1774695952.857524}
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB49418') HTTP/1.1" 204 0
2026-03-28 11:05:52 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [auto1.de] INFO: Scrape type for GK51404: 2
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70, identifier: GK51404
2026-03-28 11:05:53 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 11:05:53 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.de] INFO: Scrape type for HX44464: 2
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b407ee1-70ee-5b4c-b546-311fca521be5, identifier: HX44464
2026-03-28 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-28 11:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-28 11:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404 to the API
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:31:42Z',
 'fuel_type': 'petrol',
 'id': '0d97d5d3-552b-5f3d-b4e5-1364ddd66e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK51404',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 153790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-20',
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.de] INFO: Saving data for GK51404: {'auction_closing_time': 1774715502.0, 'created_time': 1774294616.505064, 'last_price_update_time': 1774695953.50322}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK51404') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-28 11:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-28 11:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464 to the API
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-28T16:16:00Z',
 'fuel_type': 'petrol',
 'id': '2b407ee1-70ee-5b4c-b546-311fca521be5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX44464',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 103768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.de] INFO: Saving data for HX44464: {'auction_closing_time': 1774714560.0, 'created_time': 1773685866.871994, 'last_price_update_time': 1774695953.808917}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX44464') HTTP/1.1" 204 0
2026-03-28 11:05:53 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 11:05:53 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.de] INFO: Scrape type for CT00605: 2
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce5318ef-9eac-5353-b196-ac0aac83978b, identifier: CT00605
2026-03-28 11:05:53 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [auto1.de] INFO: Scrape type for DC16754: 2
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d34997ba-710c-5886-b0ad-d9e74a82d9bf with scrape type 2
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d34997ba-710c-5886-b0ad-d9e74a82d9bf with scrape type 2
2026-03-28 11:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d34997ba-710c-5886-b0ad-d9e74a82d9bf, identifier: DC16754
2026-03-28 11:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-28 11:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-28 11:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605 to the API
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:35:11Z',
 'fuel_type': 'diesel',
 'id': 'ce5318ef-9eac-5353-b196-ac0aac83978b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT00605',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 107098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-21',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L4H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L4H2 HKa 3,5t',
 'year': 2012}
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [auto1.de] INFO: Saving data for CT00605: {'auction_closing_time': 1774715711.0, 'created_time': 1774291296.789796, 'last_price_update_time': 1774695954.395724}
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT00605') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-28 11:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-28 11:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754 to the API
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:18:21Z',
 'fuel_type': 'petrol',
 'id': 'd34997ba-710c-5886-b0ad-d9e74a82d9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC16754',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 49899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [auto1.de] INFO: Saving data for DC16754: {'auction_closing_time': 1774714701.0, 'created_time': 1774292881.417798, 'last_price_update_time': 1774695954.826228}
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC16754') HTTP/1.1" 204 0
2026-03-28 11:05:54 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [auto1.de] INFO: Scrape type for XF83287: 2
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 182166df-a758-5861-8c9c-caf74e2fa5ad, identifier: XF83287
2026-03-28 11:05:55 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 11:05:55 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 11:05:55 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-28 11:05:55 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [auto1.de] INFO: Scrape type for GR86063: 2
2026-03-28 11:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-28 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7de6619-83d8-5976-bb53-a9b4512f9c09, identifier: GR86063
2026-03-28 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-28 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-28 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287 to the API
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:43:08Z',
 'fuel_type': 'petrol',
 'id': '182166df-a758-5861-8c9c-caf74e2fa5ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF83287',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 202722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-09',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2009}
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [auto1.de] INFO: Saving data for XF83287: {'auction_closing_time': 1774716188.0, 'created_time': 1774262939.739456, 'last_price_update_time': 1774695955.445928}
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF83287') HTTP/1.1" 204 0
2026-03-28 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-28 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-28 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063 to the API
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'diesel',
 'id': 'c7de6619-83d8-5976-bb53-a9b4512f9c09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR86063',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 207463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-22',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [auto1.de] INFO: Saving data for GR86063: {'auction_closing_time': 1774714961.0, 'created_time': 1773305461.178113, 'last_price_update_time': 1774695955.781902}
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR86063') HTTP/1.1" 204 0
2026-03-28 11:05:55 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [auto1.de] INFO: Scrape type for YL63918: 2
2026-03-28 11:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-28 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ada1d1f-9b7e-5032-b57f-04208056cf3a, identifier: YL63918
2026-03-28 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-28 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-28 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918 to the API
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:36Z',
 'fuel_type': 'diesel',
 'id': '8ada1d1f-9b7e-5032-b57f-04208056cf3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL63918',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 141156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [auto1.de] INFO: Saving data for YL63918: {'auction_closing_time': 1774713936.0, 'created_time': 1773772242.996943, 'last_price_update_time': 1774695956.269718}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL63918') HTTP/1.1" 204 0
2026-03-28 11:05:56 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 11:05:56 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [auto1.de] INFO: Scrape type for LJ65077: 2
2026-03-28 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-28 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc, identifier: LJ65077
2026-03-28 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-28 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-28 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077 to the API
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:57:44Z',
 'fuel_type': 'diesel',
 'id': 'de5a2bb0-d02f-5b12-9f1c-78afc3302cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ65077',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 294927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [auto1.de] INFO: Saving data for LJ65077: {'auction_closing_time': 1774717064.0, 'created_time': 1773427287.035825, 'last_price_update_time': 1774695956.745652}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ65077') HTTP/1.1" 204 0
2026-03-28 11:05:56 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [auto1.de] INFO: Scrape type for TN14580: 2
2026-03-28 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-28 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2091fc1-4213-5c12-ad43-254edc496c33, identifier: TN14580
2026-03-28 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-28 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-28 11:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580 to the API
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:38Z',
 'fuel_type': 'diesel',
 'id': 'd2091fc1-4213-5c12-ad43-254edc496c33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN14580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 197243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-01',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [auto1.de] INFO: Saving data for TN14580: {'auction_closing_time': 1774715738.0, 'created_time': 1774263125.266287, 'last_price_update_time': 1774695957.226442}
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN14580') HTTP/1.1" 204 0
2026-03-28 11:05:57 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [auto1.de] INFO: Scrape type for ZU42459: 2
2026-03-28 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-28 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-28 11:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fc8146a-c68a-538c-9f2c-f86396a85877, identifier: ZU42459
2026-03-28 11:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-28 11:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-28 11:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459 to the API
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'petrol',
 'id': '4fc8146a-c68a-538c-9f2c-f86396a85877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU42459',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 126061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2011}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [auto1.de] INFO: Saving data for ZU42459: {'auction_closing_time': 1774715579.0, 'created_time': 1773553623.348858, 'last_price_update_time': 1774695958.199444}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU42459') HTTP/1.1" 204 0
2026-03-28 11:05:58 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 11:05:58 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [auto1.de] INFO: Scrape type for AN13363: 2
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea377221-4d6e-5a72-9b42-5f52df4920c1, identifier: AN13363
2026-03-28 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-28 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-28 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363 to the API
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:53:57Z',
 'fuel_type': 'petrol',
 'id': 'ea377221-4d6e-5a72-9b42-5f52df4920c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN13363',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 167227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Ambition Plus Edition',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [auto1.de] INFO: Saving data for AN13363: {'auction_closing_time': 1774716837.0, 'created_time': 1773858712.672628, 'last_price_update_time': 1774695958.620228}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN13363') HTTP/1.1" 204 0
2026-03-28 11:05:58 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 11:05:58 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [auto1.de] INFO: Scrape type for GJ36407: 2
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fc638e2-5f9a-5427-83ef-8968cffef920, identifier: GJ36407
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-28 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-28 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407 to the API
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:11:00Z',
 'fuel_type': 'petrol',
 'id': '9fc638e2-5f9a-5427-83ef-8968cffef920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ36407',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 17861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [auto1.de] INFO: Saving data for GJ36407: {'auction_closing_time': 1774714260.0, 'created_time': 1774262881.080456, 'last_price_update_time': 1774695959.689659}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ36407') HTTP/1.1" 204 0
2026-03-28 11:05:59 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [auto1.de] INFO: Scrape type for NW35011: 2
2026-03-28 11:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-28 11:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-28 11:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4, identifier: NW35011
2026-03-28 11:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-28 11:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-28 11:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011 to the API
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:44:57Z',
 'fuel_type': 'petrol',
 'id': '9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW35011',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 165892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [auto1.de] INFO: Saving data for NW35011: {'auction_closing_time': 1774716297.0, 'created_time': 1773303376.421663, 'last_price_update_time': 1774695960.14887}
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW35011') HTTP/1.1" 204 0
2026-03-28 11:06:00 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 11:06:00 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 11:06:00 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [auto1.de] INFO: Scrape type for YD09657: 2
2026-03-28 11:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-28 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-28 11:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9bc550b-3356-58e5-9670-73a40cd2f56b, identifier: YD09657
2026-03-28 11:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-28 11:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-28 11:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657 to the API
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:46Z',
 'fuel_type': 'diesel',
 'id': 'f9bc550b-3356-58e5-9670-73a40cd2f56b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD09657',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 164379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2010}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.de] INFO: Saving data for YD09657: {'auction_closing_time': 1774714366.0, 'created_time': 1774290713.92599, 'last_price_update_time': 1774695961.293844}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD09657') HTTP/1.1" 204 0
2026-03-28 11:06:01 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9702 | hits on page: 40
2026-03-28 11:06:01 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.de] INFO: Scrape type for XN51512: 2
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b82473b4-4037-5be2-b3d5-3d5392bfd397, identifier: XN51512
2026-03-28 11:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-28 11:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-28 11:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512 to the API
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:26Z',
 'fuel_type': 'diesel',
 'id': 'b82473b4-4037-5be2-b3d5-3d5392bfd397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN51512',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 260433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-25',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.de] INFO: Saving data for XN51512: {'auction_closing_time': 1774715726.0, 'created_time': 1772728754.130929, 'last_price_update_time': 1774695961.708294}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN51512') HTTP/1.1" 204 0
2026-03-28 11:06:01 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.de] INFO: Scrape type for HX75388: 2
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9, identifier: HX75388
2026-03-28 11:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:01 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 11:06:01 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [auto1.de] INFO: Scrape type for NM84530: 2
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10, identifier: NM84530
2026-03-28 11:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-28 11:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-28 11:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388 to the API
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:03:06Z',
 'fuel_type': 'petrol',
 'id': '9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX75388',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 50443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [auto1.de] INFO: Saving data for HX75388: {'auction_closing_time': 1774713786.0, 'created_time': 1773305150.079249, 'last_price_update_time': 1774695962.727077}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX75388') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-28 11:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-28 11:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530 to the API
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:38Z',
 'fuel_type': 'diesel',
 'id': '0d0d6a08-8052-5feb-9cec-bf4e6c5bae10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84530',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 118782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.de] INFO: Saving data for NM84530: {'auction_closing_time': 1774716758.0, 'created_time': 1773468227.047045, 'last_price_update_time': 1774695963.046362}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM84530') HTTP/1.1" 204 0
2026-03-28 11:06:03 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 11:06:03 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.de] INFO: Scrape type for FK87284: 2
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbdc3010-4710-5e62-b105-bfacf1c7d836, identifier: FK87284
2026-03-28 11:06:03 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 11:06:03 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.de] INFO: Scrape type for MS73974: 2
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95f2dc29-fad0-5f6f-84fb-346c1535ef71, identifier: MS73974
2026-03-28 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-28 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-28 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284 to the API
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'diesel',
 'id': 'dbdc3010-4710-5e62-b105-bfacf1c7d836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK87284',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 140458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [auto1.de] INFO: Saving data for FK87284: {'auction_closing_time': 1774716613.0, 'created_time': 1774291966.938551, 'last_price_update_time': 1774695963.680976}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK87284') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-28 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-28 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974 to the API
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:42:01Z',
 'fuel_type': 'diesel',
 'id': '95f2dc29-fad0-5f6f-84fb-346c1535ef71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS73974',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 156030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-08',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [auto1.de] INFO: Saving data for MS73974: {'auction_closing_time': 1774716121.0, 'created_time': 1773230356.63605, 'last_price_update_time': 1774695964.716087}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS73974') HTTP/1.1" 204 0
2026-03-28 11:06:04 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [auto1.de] INFO: Scrape type for EX44757: 2
2026-03-28 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-28 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-28 11:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 066ffbf9-6508-598f-af05-dcba518c9392, identifier: EX44757
2026-03-28 11:06:04 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [auto1.de] INFO: Scrape type for VN46305: 2
2026-03-28 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-28 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-28 11:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872d93b7-c682-5bd5-b48f-91f1eb807f59, identifier: VN46305
2026-03-28 11:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-28 11:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757 to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:05:38Z',
 'fuel_type': 'diesel',
 'id': '066ffbf9-6508-598f-af05-dcba518c9392',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX44757',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 144259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi ST',
 'transmission': 'automatic',
 'trim': 'ST',
 'year': 2016}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.de] INFO: Saving data for EX44757: {'auction_closing_time': 1774713938.0, 'created_time': 1774293911.519362, 'last_price_update_time': 1774695965.285476}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX44757') HTTP/1.1" 204 0
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305 to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:34:39Z',
 'fuel_type': 'petrol',
 'id': '872d93b7-c682-5bd5-b48f-91f1eb807f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN46305',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 180981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'BMW 7er 750i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.de] INFO: Saving data for VN46305: {'auction_closing_time': 1774715679.0, 'created_time': 1774262458.17038, 'last_price_update_time': 1774695965.616536}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN46305') HTTP/1.1" 204 0
2026-03-28 11:06:05 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.de] INFO: Scrape type for UX30716: 2
2026-03-28 11:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-28 11:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1e9fcfe-67df-57e9-8230-d565870f1a92, identifier: UX30716
2026-03-28 11:06:05 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [auto1.de] INFO: Scrape type for AS21942: 2
2026-03-28 11:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-28 11:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6090e202-fd22-588b-a67a-0c1db55df362, identifier: AS21942
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716 to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:06:56Z',
 'fuel_type': 'petrol',
 'id': 'f1e9fcfe-67df-57e9-8230-d565870f1a92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX30716',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 162477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2013}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.de] INFO: Saving data for UX30716: {'auction_closing_time': 1774714016.0, 'created_time': 1773400616.322835, 'last_price_update_time': 1774695966.269992}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX30716') HTTP/1.1" 204 0
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-28 11:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942 to the API
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:48:14Z',
 'fuel_type': 'petrol',
 'id': '6090e202-fd22-588b-a67a-0c1db55df362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS21942',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 115739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.de] INFO: Saving data for AS21942: {'auction_closing_time': 1774716494.0, 'created_time': 1773303444.607229, 'last_price_update_time': 1774695966.617465}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS21942') HTTP/1.1" 204 0
2026-03-28 11:06:06 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.de] INFO: Scrape type for CE68759: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726, identifier: CE68759
2026-03-28 11:06:06 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [auto1.de] INFO: Scrape type for RD63050: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c, identifier: RD63050
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-28 11:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759 to the API
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'diesel',
 'id': '96cf5e01-aa9b-58b6-9c21-0f3e50dd5726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE68759',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 127384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-12',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Premium Blue',
 'transmission': 'manual',
 'trim': 'Premium Blue',
 'year': 2015}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.de] INFO: Saving data for CE68759: {'auction_closing_time': 1774714335.0, 'created_time': 1773138249.071629, 'last_price_update_time': 1774695967.17941}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE68759') HTTP/1.1" 204 0
2026-03-28 11:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-28 11:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050 to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:56Z',
 'fuel_type': 'diesel',
 'id': '373e7dad-f1ce-5295-9c9b-2c9d07066e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD63050',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 127550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.de] INFO: Saving data for RD63050: {'auction_closing_time': 1774717016.0, 'created_time': 1773307953.531655, 'last_price_update_time': 1774695967.559047}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD63050') HTTP/1.1" 204 0
2026-03-28 11:06:07 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.de] INFO: Scrape type for BZ96817: 2
2026-03-28 11:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-28 11:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8813e3d3-be1d-5c4a-ab65-59260910fd45, identifier: BZ96817
2026-03-28 11:06:07 [scrapy.extensions.logstats] INFO: Crawled 429 pages (at 5 pages/min), scraped 756 items (at 106 items/min)
2026-03-28 11:06:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:06:07 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 11:06:07 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 11:06:07 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [auto1.de] INFO: Scrape type for JK39186: 2
2026-03-28 11:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-28 11:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb061c3b-9e55-5a10-9085-4141d8fcdcdd, identifier: JK39186
2026-03-28 11:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-28 11:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817 to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:57:28Z',
 'fuel_type': 'petrol',
 'id': '8813e3d3-be1d-5c4a-ab65-59260910fd45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ96817',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 44288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2017}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.de] INFO: Saving data for BZ96817: {'auction_closing_time': 1774717048.0, 'created_time': 1773427048.339126, 'last_price_update_time': 1774695968.144935}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ96817') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-28 11:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-28 11:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186 to the API
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:16:40Z',
 'fuel_type': 'petrol',
 'id': 'fb061c3b-9e55-5a10-9085-4141d8fcdcdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK39186',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 109317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-12',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2010}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.de] INFO: Saving data for JK39186: {'auction_closing_time': 1774714600.0, 'created_time': 1773304591.34334, 'last_price_update_time': 1774695968.457502}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK39186') HTTP/1.1" 204 0
2026-03-28 11:06:08 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.de] INFO: Scrape type for LZ15789: 2
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dada859d-a71c-5cab-a9e5-5b702ddfe659 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dada859d-a71c-5cab-a9e5-5b702ddfe659 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dada859d-a71c-5cab-a9e5-5b702ddfe659, identifier: LZ15789
2026-03-28 11:06:08 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 11:06:08 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.de] INFO: Scrape type for TV11727: 2
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dea8b217-5d60-5c42-ae50-137a48d1420d, identifier: TV11727
2026-03-28 11:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-28 11:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-28 11:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789 to the API
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'diesel',
 'id': 'dada859d-a71c-5cab-a9e5-5b702ddfe659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ15789',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 322491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2014}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [auto1.de] INFO: Saving data for LZ15789: {'auction_closing_time': 1774716114.0, 'created_time': 1772547110.62759, 'last_price_update_time': 1774695968.985595}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ15789') HTTP/1.1" 204 0
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-28 11:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727 to the API
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:22:42Z',
 'fuel_type': 'petrol',
 'id': 'dea8b217-5d60-5c42-ae50-137a48d1420d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV11727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 121447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [auto1.de] INFO: Saving data for TV11727: {'auction_closing_time': 1774714962.0, 'created_time': 1773401041.48768, 'last_price_update_time': 1774695969.395291}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV11727') HTTP/1.1" 204 0
2026-03-28 11:06:09 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 11:06:09 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [auto1.de] INFO: Scrape type for DE42572: 2
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557a104b-0f7c-5ec8-b511-88add1c586ed, identifier: DE42572
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-28 11:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572 to the API
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'diesel',
 'id': '557a104b-0f7c-5ec8-b511-88add1c586ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42572',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 148669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [auto1.de] INFO: Saving data for DE42572: {'auction_closing_time': 1774714523.0, 'created_time': 1772545084.892825, 'last_price_update_time': 1774695969.830311}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42572') HTTP/1.1" 204 0
2026-03-28 11:06:09 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [auto1.de] INFO: Scrape type for TV18739: 2
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a346cde0-3651-5cfc-85a0-4438ac05b9c4, identifier: TV18739
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-28 11:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739 to the API
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:51:21Z',
 'fuel_type': 'petrol',
 'id': 'a346cde0-3651-5cfc-85a0-4438ac05b9c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18739',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 50535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [auto1.de] INFO: Saving data for TV18739: {'auction_closing_time': 1774716681.0, 'created_time': 1773514026.253043, 'last_price_update_time': 1774695970.260476}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV18739') HTTP/1.1" 204 0
2026-03-28 11:06:10 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [auto1.de] INFO: Scrape type for PN31203: 2
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70, identifier: PN31203
2026-03-28 11:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-28 11:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-28 11:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203 to the API
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:23:02Z',
 'fuel_type': 'diesel',
 'id': '69ad4ae9-5eaa-5f68-b40c-9ee546dfee70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN31203',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 166216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [auto1.de] INFO: Saving data for PN31203: {'auction_closing_time': 1774714982.0, 'created_time': 1773466901.443638, 'last_price_update_time': 1774695970.687751}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN31203') HTTP/1.1" 204 0
2026-03-28 11:06:10 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [auto1.de] INFO: Scrape type for ZG62657: 2
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d, identifier: ZG62657
2026-03-28 11:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-28 11:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-28 11:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657 to the API
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:23Z',
 'fuel_type': 'petrol',
 'id': '013e5d1f-cfc7-54b4-be37-ee6a70b1586d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG62657',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 142280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.de] INFO: Saving data for ZG62657: {'auction_closing_time': 1774714343.0, 'created_time': 1773400788.519768, 'last_price_update_time': 1774695971.163655}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG62657') HTTP/1.1" 204 0
2026-03-28 11:06:11 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 11:06:11 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.de] INFO: Scrape type for FC76019: 2
2026-03-28 11:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-28 11:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-28 11:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5b138fc-5bd4-5ea9-a304-6254cfb0812c, identifier: FC76019
2026-03-28 11:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-28 11:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-28 11:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019 to the API
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:27Z',
 'fuel_type': 'diesel',
 'id': 'b5b138fc-5bd4-5ea9-a304-6254cfb0812c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC76019',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 243152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 2017}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.de] INFO: Saving data for FC76019: {'auction_closing_time': 1774715427.0, 'created_time': 1772541082.608511, 'last_price_update_time': 1774695971.59133}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC76019') HTTP/1.1" 204 0
2026-03-28 11:06:11 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 11:06:11 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-28 11:06:11 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [auto1.de] INFO: Scrape type for FG09102: 2
2026-03-28 11:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-28 11:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-28 11:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 691e4556-610d-5f26-b273-26021a1321f0, identifier: FG09102
2026-03-28 11:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-28 11:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-28 11:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102 to the API
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:31Z',
 'fuel_type': 'diesel',
 'id': '691e4556-610d-5f26-b273-26021a1321f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG09102',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 167170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2008}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [auto1.de] INFO: Saving data for FG09102: {'auction_closing_time': 1774716331.0, 'created_time': 1774262256.235742, 'last_price_update_time': 1774695972.068454}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG09102') HTTP/1.1" 204 0
2026-03-28 11:06:12 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 11:06:12 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [auto1.de] INFO: Scrape type for BY18365: 2
2026-03-28 11:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-28 11:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af, identifier: BY18365
2026-03-28 11:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-28 11:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-28 11:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365 to the API
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:11:41Z',
 'fuel_type': 'petrol',
 'id': '3eca5d5e-4fd9-5d81-b41b-fa5387c208af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY18365',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 18764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-03',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2024}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [auto1.de] INFO: Saving data for BY18365: {'auction_closing_time': 1774714301.0, 'created_time': 1774293976.229033, 'last_price_update_time': 1774695972.506127}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY18365') HTTP/1.1" 204 0
2026-03-28 11:06:12 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [auto1.de] INFO: Scrape type for BE52525: 2
2026-03-28 11:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-28 11:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406642a3-d969-5745-8934-74863490bf24, identifier: BE52525
2026-03-28 11:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-28 11:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-28 11:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525 to the API
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:14:57Z',
 'fuel_type': 'diesel',
 'id': '406642a3-d969-5745-8934-74863490bf24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52525',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 235302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Saving data for BE52525: {'auction_closing_time': 1774714497.0, 'created_time': 1774251040.727605, 'last_price_update_time': 1774695973.035833}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE52525') HTTP/1.1" 204 0
2026-03-28 11:06:13 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Scrape type for MB36683: 2
2026-03-28 11:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-28 11:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b3942e3-179c-5a20-be04-a6124833a0fc, identifier: MB36683
2026-03-28 11:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-28 11:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-28 11:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683 to the API
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-28T16:36:03Z',
 'fuel_type': 'petrol',
 'id': '8b3942e3-179c-5a20-be04-a6124833a0fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB36683',
 'listing': 'auction',
 'make': 'BMW',
 'model': '8er',
 'odometer': 61140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seller_name': None,
 'title': 'BMW 8er M850i Gran Coupe xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2021}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Saving data for MB36683: {'auction_closing_time': 1774715763.0, 'created_time': 1773772269.797104, 'last_price_update_time': 1774695973.462301}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB36683') HTTP/1.1" 204 0
2026-03-28 11:06:13 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 11:06:13 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Scrape type for PT08625: 2
2026-03-28 11:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-28 11:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d, identifier: PT08625
2026-03-28 11:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-28 11:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-28 11:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625 to the API
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:41:43Z',
 'fuel_type': 'diesel',
 'id': 'b65ed8c8-5731-5d43-aac3-c0d408dd8f9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT08625',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 209275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'Audi A4 35 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2019}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Saving data for PT08625: {'auction_closing_time': 1774716103.0, 'created_time': 1774290707.975346, 'last_price_update_time': 1774695973.863883}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT08625') HTTP/1.1" 204 0
2026-03-28 11:06:13 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [auto1.de] INFO: Scrape type for PG24864: 2
2026-03-28 11:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-28 11:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17237763-604c-519f-93bb-46962e1d116c, identifier: PG24864
2026-03-28 11:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-28 11:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-28 11:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864 to the API
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:15Z',
 'fuel_type': 'petrol',
 'id': '17237763-604c-519f-93bb-46962e1d116c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24864',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 53276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2012}
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [auto1.de] INFO: Saving data for PG24864: {'auction_closing_time': 1774716735.0, 'created_time': 1773308284.390759, 'last_price_update_time': 1774695974.274037}
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24864') HTTP/1.1" 204 0
2026-03-28 11:06:14 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 11:06:14 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [auto1.de] INFO: Scrape type for YD14218: 2
2026-03-28 11:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-28 11:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with scrape type 2
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with scrape type 2
2026-03-28 11:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54, identifier: YD14218
2026-03-28 11:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-28 11:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-28 11:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218 to the API
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:10:35Z',
 'fuel_type': 'petrol',
 'id': '1fcc3f24-5aa5-50fe-b845-76ab66bedd54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD14218',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 83502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [auto1.de] INFO: Saving data for YD14218: {'auction_closing_time': 1774714235.0, 'created_time': 1774292994.735569, 'last_price_update_time': 1774695974.714519}
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD14218') HTTP/1.1" 204 0
2026-03-28 11:06:14 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 11:06:14 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [auto1.de] INFO: Scrape type for SG17640: 2
2026-03-28 11:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-28 11:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-28 11:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24fdf72-8f38-5f2a-8daf-4114237b5712, identifier: SG17640
2026-03-28 11:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-28 11:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-28 11:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640 to the API
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:28Z',
 'fuel_type': 'petrol',
 'id': 'd24fdf72-8f38-5f2a-8daf-4114237b5712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG17640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 77728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [auto1.de] INFO: Saving data for SG17640: {'auction_closing_time': 1774714228.0, 'created_time': 1773306899.596154, 'last_price_update_time': 1774695975.145635}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG17640') HTTP/1.1" 204 0
2026-03-28 11:06:15 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [auto1.de] INFO: Scrape type for YZ38333: 2
2026-03-28 11:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-28 11:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd05870-8ece-588f-b3e9-a1a146a40638, identifier: YZ38333
2026-03-28 11:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-28 11:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-28 11:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333 to the API
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:56:40Z',
 'fuel_type': 'petrol',
 'id': '1fd05870-8ece-588f-b3e9-a1a146a40638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ38333',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 125343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [auto1.de] INFO: Saving data for YZ38333: {'auction_closing_time': 1774717000.0, 'created_time': 1773776269.351749, 'last_price_update_time': 1774695975.626431}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ38333') HTTP/1.1" 204 0
2026-03-28 11:06:15 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 11:06:15 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 11:06:15 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [auto1.de] INFO: Scrape type for AB26225: 2
2026-03-28 11:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-28 11:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33, identifier: AB26225
2026-03-28 11:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-28 11:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-28 11:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225 to the API
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'diesel',
 'id': '63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB26225',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 25742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [auto1.de] INFO: Saving data for AB26225: {'auction_closing_time': 1774716347.0, 'created_time': 1773773960.64453, 'last_price_update_time': 1774695976.115537}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB26225') HTTP/1.1" 204 0
2026-03-28 11:06:16 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [auto1.de] INFO: Scrape type for SE32009: 2
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1388515-9030-558e-8089-f77320185b27, identifier: SE32009
2026-03-28 11:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-28 11:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-28 11:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009 to the API
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:19:46Z',
 'fuel_type': 'diesel',
 'id': 'd1388515-9030-558e-8089-f77320185b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE32009',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 284650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2015}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [auto1.de] INFO: Saving data for SE32009: {'auction_closing_time': 1774714786.0, 'created_time': 1773775854.531316, 'last_price_update_time': 1774695976.745691}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE32009') HTTP/1.1" 204 0
2026-03-28 11:06:16 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 11:06:16 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [auto1.de] INFO: Scrape type for RR41525: 2
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65642d36-689c-5634-88d0-5a907136b411 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65642d36-689c-5634-88d0-5a907136b411 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65642d36-689c-5634-88d0-5a907136b411, identifier: RR41525
2026-03-28 11:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-28 11:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-28 11:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525 to the API
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:12Z',
 'fuel_type': 'diesel',
 'id': '65642d36-689c-5634-88d0-5a907136b411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR41525',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 112985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2019}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [auto1.de] INFO: Saving data for RR41525: {'auction_closing_time': 1774713852.0, 'created_time': 1774608096.689139, 'last_price_update_time': 1774695977.246519}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR41525') HTTP/1.1" 204 0
2026-03-28 11:06:17 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 11:06:17 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 11:06:17 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [auto1.de] INFO: Scrape type for ZV40367: 2
2026-03-28 11:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-28 11:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343825b6-49dc-5a85-9088-4793f940efd8, identifier: ZV40367
2026-03-28 11:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-28 11:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-28 11:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367 to the API
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:24:00Z',
 'fuel_type': 'diesel',
 'id': '343825b6-49dc-5a85-9088-4793f940efd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV40367',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 165182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2020}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [auto1.de] INFO: Saving data for ZV40367: {'auction_closing_time': 1774715040.0, 'created_time': 1774293764.556894, 'last_price_update_time': 1774695977.679069}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV40367') HTTP/1.1" 204 0
2026-03-28 11:06:17 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [auto1.de] INFO: Scrape type for GS33010: 2
2026-03-28 11:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-28 11:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68add022-1957-5f1e-b41c-9cc43047c1e6, identifier: GS33010
2026-03-28 11:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-28 11:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-28 11:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010 to the API
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:57Z',
 'fuel_type': 'diesel',
 'id': '68add022-1957-5f1e-b41c-9cc43047c1e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS33010',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 136487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2016}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [auto1.de] INFO: Saving data for GS33010: {'auction_closing_time': 1774713657.0, 'created_time': 1773306688.360531, 'last_price_update_time': 1774695978.130334}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS33010') HTTP/1.1" 204 0
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:06:38 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9703 | hits on page: 40
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Scrape type for LK17231: 2
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 726745aa-17cc-59d9-8902-f42288787c70, identifier: LK17231
2026-03-28 11:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-28 11:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-28 11:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231 to the API
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:05:44Z',
 'fuel_type': 'petrol',
 'id': '726745aa-17cc-59d9-8902-f42288787c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK17231',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 57672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-31',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Saving data for LK17231: {'auction_closing_time': 1774713944.0, 'created_time': 1773138506.134942, 'last_price_update_time': 1774695998.510278}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK17231') HTTP/1.1" 204 0
2026-03-28 11:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Scrape type for YJ71992: 2
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e075a32-3f89-5397-83f9-ea619d98c775, identifier: YJ71992
2026-03-28 11:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-28 11:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-28 11:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992 to the API
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:46:58Z',
 'fuel_type': 'petrol',
 'id': '6e075a32-3f89-5397-83f9-ea619d98c775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ71992',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 98553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Passion blue',
 'transmission': 'manual',
 'trim': 'Passion blue',
 'year': 2017}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Saving data for YJ71992: {'auction_closing_time': 1774716418.0, 'created_time': 1773399081.076848, 'last_price_update_time': 1774695998.918862}
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ71992') HTTP/1.1" 204 0
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 11:06:38 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [auto1.de] INFO: Scrape type for CJ15757: 2
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-28 11:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09438e73-d914-53f3-bada-408f83318c2d, identifier: CJ15757
2026-03-28 11:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-28 11:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-28 11:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757 to the API
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:15Z',
 'fuel_type': 'petrol',
 'id': '09438e73-d914-53f3-bada-408f83318c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ15757',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 80798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-01-31',
 'seller_name': None,
 'title': 'Ford Mondeo 1.8 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2000}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [auto1.de] INFO: Saving data for CJ15757: {'auction_closing_time': 1774714995.0, 'created_time': 1774290787.757626, 'last_price_update_time': 1774695999.368706}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ15757') HTTP/1.1" 204 0
2026-03-28 11:06:39 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [auto1.de] INFO: Scrape type for PZ40966: 2
2026-03-28 11:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-28 11:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-28 11:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754, identifier: PZ40966
2026-03-28 11:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-28 11:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-28 11:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966 to the API
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:26:02Z',
 'fuel_type': 'diesel',
 'id': '6fad701c-4d70-5dbe-86d4-b3e0b5f9c754',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ40966',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 315753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [auto1.de] INFO: Saving data for PZ40966: {'auction_closing_time': 1774715162.0, 'created_time': 1774264778.726008, 'last_price_update_time': 1774695999.894056}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ40966') HTTP/1.1" 204 0
2026-03-28 11:06:39 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 11:06:39 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [auto1.de] INFO: Scrape type for ED19748: 2
2026-03-28 11:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-28 11:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-28 11:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ebe3833-29fb-5033-941d-3bb64549385d, identifier: ED19748
2026-03-28 11:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-28 11:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-28 11:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748 to the API
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:01:06Z',
 'fuel_type': 'diesel',
 'id': '4ebe3833-29fb-5033-941d-3bb64549385d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED19748',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 308342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueTDI',
 'transmission': 'automatic',
 'trim': 'Highline BlueTDI',
 'year': 2011}
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [auto1.de] INFO: Saving data for ED19748: {'auction_closing_time': 1774713666.0, 'created_time': 1773772239.384143, 'last_price_update_time': 1774696000.341321}
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED19748') HTTP/1.1" 204 0
2026-03-28 11:06:40 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 11:06:40 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [auto1.de] INFO: Scrape type for WP48150: 2
2026-03-28 11:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-28 11:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 2
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 2
2026-03-28 11:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c, identifier: WP48150
2026-03-28 11:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-28 11:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-28 11:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150 to the API
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:37:35Z',
 'fuel_type': 'petrol',
 'id': '1982e3b9-ef4e-545d-a53b-6cc527e6af8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48150',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 37123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-04',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [auto1.de] INFO: Saving data for WP48150: {'auction_closing_time': 1774715855.0, 'created_time': 1774608101.901565, 'last_price_update_time': 1774696000.756066}
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48150') HTTP/1.1" 204 0
2026-03-28 11:06:40 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 11:06:40 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 11:06:40 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [auto1.de] INFO: Scrape type for MZ72792: 2
2026-03-28 11:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-28 11:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-28 11:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d010d4d-9a59-5c69-a014-5c837822749c, identifier: MZ72792
2026-03-28 11:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-28 11:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-28 11:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792 to the API
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:52Z',
 'fuel_type': 'petrol',
 'id': '2d010d4d-9a59-5c69-a014-5c837822749c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ72792',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 68453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [auto1.de] INFO: Saving data for MZ72792: {'auction_closing_time': 1774716532.0, 'created_time': 1774294843.294277, 'last_price_update_time': 1774696001.194411}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ72792') HTTP/1.1" 204 0
2026-03-28 11:06:41 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [auto1.de] INFO: Scrape type for DH13363: 2
2026-03-28 11:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-28 11:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-28 11:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f6be045-35c8-5181-bff7-9484fde1cc59, identifier: DH13363
2026-03-28 11:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-28 11:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-28 11:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363 to the API
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:47:09Z',
 'fuel_type': 'hybrid',
 'id': '9f6be045-35c8-5181-bff7-9484fde1cc59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH13363',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 86712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seller_name': None,
 'title': 'BMW 5er 545e xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [auto1.de] INFO: Saving data for DH13363: {'auction_closing_time': 1774716429.0, 'created_time': 1772541914.691906, 'last_price_update_time': 1774696001.622138}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH13363') HTTP/1.1" 204 0
2026-03-28 11:06:41 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 11:06:41 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [auto1.de] INFO: Scrape type for YE69852: 2
2026-03-28 11:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-28 11:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-28 11:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd270fc7-7388-5dbe-b8e0-a314ba978fd3, identifier: YE69852
2026-03-28 11:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-28 11:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-28 11:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852 to the API
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:25:06Z',
 'fuel_type': 'diesel',
 'id': 'cd270fc7-7388-5dbe-b8e0-a314ba978fd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE69852',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 162044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2022}
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [auto1.de] INFO: Saving data for YE69852: {'auction_closing_time': 1774715106.0, 'created_time': 1774292323.627707, 'last_price_update_time': 1774696002.054601}
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE69852') HTTP/1.1" 204 0
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [auto1.de] INFO: Scrape type for KT10840: 2
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-28 11:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3, identifier: KT10840
2026-03-28 11:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-28 11:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-28 11:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840 to the API
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:28:46Z',
 'fuel_type': 'diesel',
 'id': 'a9482a3f-a4d1-5e4e-9de1-bae9acefdff3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT10840',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 159916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-13',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2012}
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [auto1.de] INFO: Saving data for KT10840: {'auction_closing_time': 1774715326.0, 'created_time': 1773859686.043765, 'last_price_update_time': 1774696002.611068}
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT10840') HTTP/1.1" 204 0
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 11:06:42 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-28 11:06:42 [auto1.de] INFO: Scrape type for PA97502: 2
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-28 11:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-28 11:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa, identifier: PA97502
2026-03-28 11:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-28 11:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-28 11:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502 to the API
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:06:00Z',
 'fuel_type': 'petrol',
 'id': '9d559c7c-361b-5c58-a8ca-c2bc92fd41aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA97502',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 21785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Suzuki SX4 1.0 BoosterJet Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [auto1.de] INFO: Saving data for PA97502: {'auction_closing_time': 1774713960.0, 'created_time': 1773513855.997175, 'last_price_update_time': 1774696003.042813}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA97502') HTTP/1.1" 204 0
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [auto1.de] INFO: Scrape type for ZS46633: 2
2026-03-28 11:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-28 11:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-28 11:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a8ca54-f1c9-54af-8c63-909933dca976, identifier: ZS46633
2026-03-28 11:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-28 11:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-28 11:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633 to the API
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:51:50Z',
 'fuel_type': 'diesel',
 'id': '16a8ca54-f1c9-54af-8c63-909933dca976',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS46633',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 120588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [auto1.de] INFO: Saving data for ZS46633: {'auction_closing_time': 1774716710.0, 'created_time': 1774294707.804659, 'last_price_update_time': 1774696003.458588}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS46633') HTTP/1.1" 204 0
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [auto1.de] INFO: Scrape type for DW94281: 2
2026-03-28 11:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-28 11:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-28 11:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192065ea-4837-5530-b55a-136c4bd63fb6, identifier: DW94281
2026-03-28 11:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-28 11:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-28 11:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281 to the API
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:02Z',
 'fuel_type': 'petrol',
 'id': '192065ea-4837-5530-b55a-136c4bd63fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW94281',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 188120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2010}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [auto1.de] INFO: Saving data for DW94281: {'auction_closing_time': 1774716962.0, 'created_time': 1773399868.924884, 'last_price_update_time': 1774696003.960634}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW94281') HTTP/1.1" 204 0
2026-03-28 11:06:43 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [auto1.de] INFO: Scrape type for ZL76152: 2
2026-03-28 11:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-28 11:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d38d383-9e06-5511-a737-bad9cc168a9f, identifier: ZL76152
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-28 11:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152 to the API
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:19:49Z',
 'fuel_type': 'petrol',
 'id': '8d38d383-9e06-5511-a737-bad9cc168a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL76152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 105595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [auto1.de] INFO: Saving data for ZL76152: {'auction_closing_time': 1774714789.0, 'created_time': 1773860325.950857, 'last_price_update_time': 1774696004.401919}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL76152') HTTP/1.1" 204 0
2026-03-28 11:06:44 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [auto1.de] INFO: Scrape type for XM62598: 2
2026-03-28 11:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-28 11:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac98c68d-0c56-58a4-be10-88fa949d6da3, identifier: XM62598
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-28 11:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598 to the API
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:20:29Z',
 'fuel_type': 'diesel',
 'id': 'ac98c68d-0c56-58a4-be10-88fa949d6da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM62598',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 160561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [auto1.de] INFO: Saving data for XM62598: {'auction_closing_time': 1774714829.0, 'created_time': 1773859175.463235, 'last_price_update_time': 1774696004.840416}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM62598') HTTP/1.1" 204 0
2026-03-28 11:06:44 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 11:06:44 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 11:06:44 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [auto1.de] INFO: Scrape type for LV98525: 2
2026-03-28 11:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-28 11:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-28 11:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb222700-2d65-5811-b59a-94d310519ef8, identifier: LV98525
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-28 11:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525 to the API
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:31Z',
 'fuel_type': 'petrol',
 'id': 'eb222700-2d65-5811-b59a-94d310519ef8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV98525',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 114641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Comfortline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [auto1.de] INFO: Saving data for LV98525: {'auction_closing_time': 1774714531.0, 'created_time': 1773341874.231617, 'last_price_update_time': 1774696005.255574}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV98525') HTTP/1.1" 204 0
2026-03-28 11:06:45 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [auto1.de] INFO: Scrape type for CV89057: 2
2026-03-28 11:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-28 11:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-28 11:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e01bac-766d-5890-905e-f1b51cedee13, identifier: CV89057
2026-03-28 11:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-28 11:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-28 11:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057 to the API
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': '39e01bac-766d-5890-905e-f1b51cedee13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV89057',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 73793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-03',
 'seller_name': None,
 'title': 'BMW 3er 330i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [auto1.de] INFO: Saving data for CV89057: {'auction_closing_time': 1774715336.0, 'created_time': 1773775548.891016, 'last_price_update_time': 1774696005.667359}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV89057') HTTP/1.1" 204 0
2026-03-28 11:06:45 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [auto1.de] INFO: Scrape type for VL85665: 2
2026-03-28 11:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-28 11:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-28 11:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e577adca-0663-5fe8-a520-8be939a414b4, identifier: VL85665
2026-03-28 11:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-28 11:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-28 11:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665 to the API
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:05Z',
 'fuel_type': 'petrol',
 'id': 'e577adca-0663-5fe8-a520-8be939a414b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL85665',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 76325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2013}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 11:06:46 [auto1.de] INFO: Saving data for VL85665: {'auction_closing_time': 1774716605.0, 'created_time': 1774292314.418907, 'last_price_update_time': 1774696006.143828}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL85665') HTTP/1.1" 204 0
2026-03-28 11:06:46 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 11:06:46 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 11:06:46 [auto1.de] INFO: Scrape type for EC38320: 2
2026-03-28 11:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-28 11:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-28 11:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6a751a-545c-5e48-a2ef-e082675a23e7, identifier: EC38320
2026-03-28 11:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-28 11:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-28 11:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320 to the API
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:10:04Z',
 'fuel_type': 'petrol',
 'id': '6a6a751a-545c-5e48-a2ef-e082675a23e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC38320',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 126278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2016}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 11:06:46 [auto1.de] INFO: Saving data for EC38320: {'auction_closing_time': 1774714204.0, 'created_time': 1774290672.439097, 'last_price_update_time': 1774696006.606238}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC38320') HTTP/1.1" 204 0
2026-03-28 11:07:06 [scrapy.extensions.logstats] INFO: Crawled 430 pages (at 1 pages/min), scraped 798 items (at 42 items/min)
2026-03-28 11:07:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:08:06 [scrapy.extensions.logstats] INFO: Crawled 430 pages (at 0 pages/min), scraped 798 items (at 0 items/min)
2026-03-28 11:08:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:08:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.965(s), this was the 1st time calling it.
2026-03-28 11:08:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.236692128186558 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 11:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 11:09:06 [scrapy.extensions.logstats] INFO: Crawled 430 pages (at 0 pages/min), scraped 798 items (at 0 items/min)
2026-03-28 11:09:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:16 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for KK20650: 2
2026-03-28 11:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-28 11:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7, identifier: KK20650
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:15:29Z',
 'fuel_type': 'petrol',
 'id': '95ab3343-5ae0-58d5-a0c2-f71d75d86bb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK20650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 222034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Saving data for KK20650: {'auction_closing_time': 1774714529.0, 'created_time': 1773858654.076532, 'last_price_update_time': 1774696157.501994}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK20650') HTTP/1.1" 204 0
2026-03-28 11:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:17 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Scrape type for ZY62714: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aac8b8a-e6ff-50e7-ad34-5b5751990815, identifier: ZY62714
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:44:19Z',
 'fuel_type': 'petrol',
 'id': '9aac8b8a-e6ff-50e7-ad34-5b5751990815',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY62714',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 196122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-11',
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Saving data for ZY62714: {'auction_closing_time': 1774716259.0, 'created_time': 1773305612.110451, 'last_price_update_time': 1774696158.026507}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY62714') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Scrape type for UB45914: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9b5d624-463b-5ff3-adf8-fda5f7a092b0, identifier: UB45914
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:53:45Z',
 'fuel_type': 'petrol',
 'id': 'b9b5d624-463b-5ff3-adf8-fda5f7a092b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45914',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 14299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Saving data for UB45914: {'auction_closing_time': 1774716825.0, 'created_time': 1773134726.310967, 'last_price_update_time': 1774696158.476938}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45914') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Scrape type for CM72901: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26265610-a3a5-57d7-af23-6a7033a17a58, identifier: CM72901
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:59Z',
 'fuel_type': 'petrol',
 'id': '26265610-a3a5-57d7-af23-6a7033a17a58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM72901',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 22668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
 'transmission': 'manual',
 'trim': 'ACT S line',
 'year': 2021}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Saving data for CM72901: {'auction_closing_time': 1774715759.0, 'created_time': 1773305916.665395, 'last_price_update_time': 1774696158.952231}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM72901') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Scrape type for FT64995: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f126b95-5027-5a84-b75f-b2351277ebd4, identifier: FT64995
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-28 11:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995 to the API
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:05Z',
 'fuel_type': 'petrol',
 'id': '8f126b95-5027-5a84-b75f-b2351277ebd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64995',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 141860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.4 TSI ACT Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Saving data for FT64995: {'auction_closing_time': 1774716005.0, 'created_time': 1773427432.40136, 'last_price_update_time': 1774696159.37913}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64995') HTTP/1.1" 204 0
2026-03-28 11:09:19 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Scrape type for TD54604: 2
2026-03-28 11:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-28 11:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b15ff8-c947-5a41-9ebe-b88869245f47, identifier: TD54604
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-28 11:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604 to the API
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:53:26Z',
 'fuel_type': 'diesel',
 'id': '17b15ff8-c947-5a41-9ebe-b88869245f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD54604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 195114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Saving data for TD54604: {'auction_closing_time': 1774716806.0, 'created_time': 1773341236.375464, 'last_price_update_time': 1774696159.792328}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD54604') HTTP/1.1" 204 0
2026-03-28 11:09:19 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 11:09:19 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 11:09:19 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Scrape type for HA10430: 2
2026-03-28 11:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-28 11:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd0e221-f794-59ec-8975-d479bc20b4ff, identifier: HA10430
2026-03-28 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-28 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-28 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430 to the API
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:13Z',
 'fuel_type': 'petrol',
 'id': '4dd0e221-f794-59ec-8975-d479bc20b4ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA10430',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 216830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 MIVEC Invite ClearTec 4WD',
 'transmission': 'automatic',
 'trim': 'Invite ClearTec 4WD',
 'year': 2014}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.de] INFO: Saving data for HA10430: {'auction_closing_time': 1774716373.0, 'created_time': 1773342431.988387, 'last_price_update_time': 1774696160.374104}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA10430') HTTP/1.1" 204 0
2026-03-28 11:09:20 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.de] INFO: Scrape type for DJ74169: 2
2026-03-28 11:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-28 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1, identifier: DJ74169
2026-03-28 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-28 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-28 11:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169 to the API
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'petrol',
 'id': 'ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ74169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 153965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-27',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.de] INFO: Saving data for DJ74169: {'auction_closing_time': 1774715744.0, 'created_time': 1773859441.602751, 'last_price_update_time': 1774696160.780807}
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ74169') HTTP/1.1" 204 0
2026-03-28 11:09:20 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 11:09:20 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 11:09:20 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 11:09:20 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-28 11:09:20 [auto1.de] INFO: Scrape type for GA26329: 2
2026-03-28 11:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-28 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-28 11:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5802b382-5b34-5132-8e3e-aef61e3dd92f, identifier: GA26329
2026-03-28 11:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-28 11:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-28 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329 to the API
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:18:55Z',
 'fuel_type': 'petrol',
 'id': '5802b382-5b34-5132-8e3e-aef61e3dd92f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA26329',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 156840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-03',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2012}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.de] INFO: Saving data for GA26329: {'auction_closing_time': 1774714735.0, 'created_time': 1773138515.917524, 'last_price_update_time': 1774696161.281472}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA26329') HTTP/1.1" 204 0
2026-03-28 11:09:21 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 11:09:21 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.de] INFO: Scrape type for LD79531: 2
2026-03-28 11:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-28 11:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9ed45b-4afa-5635-9edc-35391ded3f62, identifier: LD79531
2026-03-28 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-28 11:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-28 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531 to the API
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:31Z',
 'fuel_type': 'diesel',
 'id': 'ba9ed45b-4afa-5635-9edc-35391ded3f62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD79531',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 129735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.de] INFO: Saving data for LD79531: {'auction_closing_time': 1774713691.0, 'created_time': 1773340486.428731, 'last_price_update_time': 1774696161.701141}
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD79531') HTTP/1.1" 204 0
2026-03-28 11:09:21 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-28 11:09:21 [auto1.de] INFO: Scrape type for GN68043: 2
2026-03-28 11:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-28 11:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-28 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd56c9d-c984-5d14-b99e-3053d8342966, identifier: GN68043
2026-03-28 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-28 11:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-28 11:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043 to the API
2026-03-28 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:14Z',
 'fuel_type': 'diesel',
 'id': '9dd56c9d-c984-5d14-b99e-3053d8342966',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN68043',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 253628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.de] INFO: Saving data for GN68043: {'auction_closing_time': 1774716254.0, 'created_time': 1773306614.871053, 'last_price_update_time': 1774696162.140276}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN68043') HTTP/1.1" 204 0
2026-03-28 11:09:22 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 11:09:22 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.de] INFO: Scrape type for WX41369: 2
2026-03-28 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-28 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b174d140-f8da-58ec-b72b-b43d631e9093, identifier: WX41369
2026-03-28 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-28 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-28 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369 to the API
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:58Z',
 'fuel_type': 'petrol',
 'id': 'b174d140-f8da-58ec-b72b-b43d631e9093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX41369',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 112785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Opel Adam 1.0 Turbo Jam ecoFlex',
 'transmission': 'manual',
 'trim': 'Jam ecoFlex',
 'year': 2015}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.de] INFO: Saving data for WX41369: {'auction_closing_time': 1774714258.0, 'created_time': 1773732648.753932, 'last_price_update_time': 1774696162.630147}
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX41369') HTTP/1.1" 204 0
2026-03-28 11:09:22 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 11:09:22 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 11:09:22 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-28 11:09:22 [auto1.de] INFO: Scrape type for HE96933: 2
2026-03-28 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-28 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-28 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce, identifier: HE96933
2026-03-28 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-28 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-28 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933 to the API
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'diesel',
 'id': '82c9a233-8f06-5e3b-a244-71c5b7cfc8ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE96933',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 244830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-07',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.de] INFO: Saving data for HE96933: {'auction_closing_time': 1774716936.0, 'created_time': 1773305051.836881, 'last_price_update_time': 1774696163.059771}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE96933') HTTP/1.1" 204 0
2026-03-28 11:09:23 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.de] INFO: Scrape type for XW28946: 2
2026-03-28 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-28 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5b8b62-6873-5f31-b225-10d311b0e2d9, identifier: XW28946
2026-03-28 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-28 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-28 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946 to the API
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:41:16Z',
 'fuel_type': 'petrol',
 'id': '7f5b8b62-6873-5f31-b225-10d311b0e2d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW28946',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5 Sportback',
 'odometer': 183280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.de] INFO: Saving data for XW28946: {'auction_closing_time': 1774716076.0, 'created_time': 1773343442.905176, 'last_price_update_time': 1774696163.521844}
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW28946') HTTP/1.1" 204 0
2026-03-28 11:09:23 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-28 11:09:23 [auto1.de] INFO: Scrape type for ZC62608: 2
2026-03-28 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-28 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-28 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a72532a-4689-5c03-9d16-9e00acd0c1ed, identifier: ZC62608
2026-03-28 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-28 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-28 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608 to the API
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:55:18Z',
 'fuel_type': 'diesel',
 'id': '6a72532a-4689-5c03-9d16-9e00acd0c1ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC62608',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 78140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 3,0t Komfort',
 'transmission': 'manual',
 'trim': 'L2H1 3,0t Komfort',
 'year': 2021}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Saving data for ZC62608: {'auction_closing_time': 1774716918.0, 'created_time': 1773774740.948386, 'last_price_update_time': 1774696164.015889}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC62608') HTTP/1.1" 204 0
2026-03-28 11:09:24 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Scrape type for PU35807: 2
2026-03-28 11:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-28 11:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8965b60-f102-5a75-b8c7-81d8914968d8 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8965b60-f102-5a75-b8c7-81d8914968d8 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8965b60-f102-5a75-b8c7-81d8914968d8, identifier: PU35807
2026-03-28 11:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-28 11:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-28 11:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807 to the API
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:20:40Z',
 'fuel_type': 'petrol',
 'id': 'b8965b60-f102-5a75-b8c7-81d8914968d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU35807',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5 Sportback',
 'odometer': 151610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Saving data for PU35807: {'auction_closing_time': 1774714840.0, 'created_time': 1773224108.360448, 'last_price_update_time': 1774696164.428775}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU35807') HTTP/1.1" 204 0
2026-03-28 11:09:24 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Scrape type for AH71943: 2
2026-03-28 11:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-28 11:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0, identifier: AH71943
2026-03-28 11:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-28 11:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-28 11:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943 to the API
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:28:36Z',
 'fuel_type': 'diesel',
 'id': 'cc3dc508-45ad-56f8-a95d-dd1d888a6fb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH71943',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 172178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2015}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Saving data for AH71943: {'auction_closing_time': 1774715316.0, 'created_time': 1774608103.724049, 'last_price_update_time': 1774696164.854283}
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH71943') HTTP/1.1" 204 0
2026-03-28 11:09:24 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-28 11:09:24 [auto1.de] INFO: Scrape type for WJ12441: 2
2026-03-28 11:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-28 11:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-28 11:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6aa33add-c523-5d9f-b634-ff71d39e443d, identifier: WJ12441
2026-03-28 11:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-28 11:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-28T16:38:27Z',
 'fuel_type': 'petrol',
 'id': '6aa33add-c523-5d9f-b634-ff71d39e443d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ12441',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 29731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seller_name': None,
 'title': 'BMW 4er M440i Gran Coupe Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Saving data for WJ12441: {'auction_closing_time': 1774715907.0, 'created_time': 1773305269.13445, 'last_price_update_time': 1774696165.268902}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ12441') HTTP/1.1" 204 0
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for HX82785: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30ca088d-784a-53d8-a460-c0e26c2c666b, identifier: HX82785
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'petrol',
 'id': '30ca088d-784a-53d8-a460-c0e26c2c666b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX82785',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 140203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
 'transmission': 'automatic',
 'trim': 'quattro Performance',
 'year': 2016}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Saving data for HX82785: {'auction_closing_time': 1774714551.0, 'created_time': 1773135013.354186, 'last_price_update_time': 1774696165.702397}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX82785') HTTP/1.1" 204 0
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for ZA19141: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecc60949-4263-55a6-a4eb-d8a0491e92d1, identifier: ZA19141
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:43Z',
 'fuel_type': 'petrol',
 'id': 'ecc60949-4263-55a6-a4eb-d8a0491e92d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA19141',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 83622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Saving data for ZA19141: {'auction_closing_time': 1774716403.0, 'created_time': 1774294492.820083, 'last_price_update_time': 1774696166.24784}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA19141') HTTP/1.1" 204 0
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Scrape type for BB20328: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169408c3-b369-5eab-a4dc-b53a94b9a0c7, identifier: BB20328
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:31:53Z',
 'fuel_type': 'diesel',
 'id': '169408c3-b369-5eab-a4dc-b53a94b9a0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB20328',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 266848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2012}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Saving data for BB20328: {'auction_closing_time': 1774715513.0, 'created_time': 1773774729.471735, 'last_price_update_time': 1774696166.689842}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB20328') HTTP/1.1" 204 0
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Scrape type for GE94001: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d, identifier: GE94001
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:27Z',
 'fuel_type': 'diesel',
 'id': '4e618fac-94aa-5c5b-9e49-ba83593bfd3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE94001',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 252005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.de] INFO: Saving data for GE94001: {'auction_closing_time': 1774717047.0, 'created_time': 1773660205.167234, 'last_price_update_time': 1774696167.164009}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE94001') HTTP/1.1" 204 0
2026-03-28 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:28 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:28 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Scrape type for BA36034: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f410b642-71d6-5523-9cc7-ef811ebbf347, identifier: BA36034
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:17:19Z',
 'fuel_type': 'petrol',
 'id': 'f410b642-71d6-5523-9cc7-ef811ebbf347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA36034',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 147683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2015}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Saving data for BA36034: {'auction_closing_time': 1774714639.0, 'created_time': 1774293774.302122, 'last_price_update_time': 1774696168.558172}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA36034') HTTP/1.1" 204 0
2026-03-28 11:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:28 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 11:09:28 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Scrape type for DN11419: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614, identifier: DN11419
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:19Z',
 'fuel_type': 'petrol',
 'id': 'de7ec40f-8acf-56d7-8ab5-3f2b2ff20614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN11419',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 15758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Nightline Edition',
 'transmission': 'automatic',
 'trim': 'Nightline Edition',
 'year': 2024}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Saving data for DN11419: {'auction_closing_time': 1774713919.0, 'created_time': 1774291795.529176, 'last_price_update_time': 1774696168.99768}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN11419') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Scrape type for HL77146: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18591d8e-6685-5dda-a802-8e18af14aef7, identifier: HL77146
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:00:15Z',
 'fuel_type': 'petrol',
 'id': '18591d8e-6685-5dda-a802-8e18af14aef7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL77146',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 186261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Saving data for HL77146: {'auction_closing_time': 1774713615.0, 'created_time': 1773399963.704201, 'last_price_update_time': 1774696169.49688}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL77146') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Scrape type for RM91715: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5, identifier: RM91715
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:38:43Z',
 'fuel_type': 'petrol',
 'id': '94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM91715',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 154178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for RM91715: {'auction_closing_time': 1774715923.0, 'created_time': 1773772301.289923, 'last_price_update_time': 1774696170.047339}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM91715') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for BX52940: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1175ce4-7c16-548c-9189-ef5ea835886e, identifier: BX52940
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:11:32Z',
 'fuel_type': 'petrol',
 'id': 'd1175ce4-7c16-548c-9189-ef5ea835886e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX52940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 102653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for BX52940: {'auction_closing_time': 1774714292.0, 'created_time': 1773859485.331411, 'last_price_update_time': 1774696170.503471}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX52940') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for HA89104: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a1a4486-9c78-5465-9509-4c7b0fdabced, identifier: HA89104
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:51:08Z',
 'fuel_type': 'petrol',
 'id': '6a1a4486-9c78-5465-9509-4c7b0fdabced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA89104',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 100824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for HA89104: {'auction_closing_time': 1774716668.0, 'created_time': 1774264672.881636, 'last_price_update_time': 1774696170.935936}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA89104') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for XB63753: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218, identifier: XB63753
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-28 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753 to the API
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:09Z',
 'fuel_type': 'diesel',
 'id': '4debdf0a-380f-50b9-a8e0-ca94ac8f9218',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB63753',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 219080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.de] INFO: Saving data for XB63753: {'auction_closing_time': 1774713849.0, 'created_time': 1773858641.025574, 'last_price_update_time': 1774696171.691777}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB63753') HTTP/1.1" 204 0
2026-03-28 11:09:31 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 11:09:31 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.de] INFO: Scrape type for FV41920: 2
2026-03-28 11:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-28 11:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ced39d6-2b53-5571-830a-fae337852c3f, identifier: FV41920
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-28 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920 to the API
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:12:38Z',
 'fuel_type': 'petrol',
 'id': '1ced39d6-2b53-5571-830a-fae337852c3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV41920',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 14638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-04',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2024}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Saving data for FV41920: {'auction_closing_time': 1774714358.0, 'created_time': 1774293426.868566, 'last_price_update_time': 1774696172.163177}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV41920') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Scrape type for XB43693: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b1058e7-4540-5f61-b879-830ee46b1b64, identifier: XB43693
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:41:20Z',
 'fuel_type': 'diesel',
 'id': '3b1058e7-4540-5f61-b879-830ee46b1b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB43693',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 138253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Saving data for XB43693: {'auction_closing_time': 1774716080.0, 'created_time': 1774294167.329932, 'last_price_update_time': 1774696172.675556}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB43693') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Scrape type for NZ04570: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b463400-3d4f-5b3a-9f36-335d5f2fa506, identifier: NZ04570
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:32:10Z',
 'fuel_type': 'diesel',
 'id': '8b463400-3d4f-5b3a-9f36-335d5f2fa506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ04570',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 96390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Saving data for NZ04570: {'auction_closing_time': 1774715530.0, 'created_time': 1773467017.480534, 'last_price_update_time': 1774696173.152515}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ04570') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Scrape type for JR30174: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54cb350d-5fe5-5e4e-b0fc-259e34488c39, identifier: JR30174
2026-03-28 11:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-28 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174 to the API
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:51Z',
 'fuel_type': 'diesel',
 'id': '54cb350d-5fe5-5e4e-b0fc-259e34488c39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR30174',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 131279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-12',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2013}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Saving data for JR30174: {'auction_closing_time': 1774714611.0, 'created_time': 1773302399.342569, 'last_price_update_time': 1774696173.859495}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR30174') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Scrape type for VL16221: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78695a34-f65d-54c3-9d90-da9a1f75177b, identifier: VL16221
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:40Z',
 'fuel_type': 'diesel',
 'id': '78695a34-f65d-54c3-9d90-da9a1f75177b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL16221',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 103450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2019}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Saving data for VL16221: {'auction_closing_time': 1774714840.0, 'created_time': 1774291736.668782, 'last_price_update_time': 1774696174.30451}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL16221') HTTP/1.1" 204 0
2026-03-28 11:09:34 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 11:09:34 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Scrape type for LD21016: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 547c35b1-695f-5512-8582-39ff6840a886, identifier: LD21016
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:46:54Z',
 'fuel_type': 'diesel',
 'id': '547c35b1-695f-5512-8582-39ff6840a886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD21016',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 227356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-18',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Best of',
 'transmission': 'automatic',
 'trim': 'Best of',
 'year': 2015}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Saving data for LD21016: {'auction_closing_time': 1774716414.0, 'created_time': 1773775532.204878, 'last_price_update_time': 1774696174.770382}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD21016') HTTP/1.1" 204 0
2026-03-28 11:09:34 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:34 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Scrape type for WK73698: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 063e5226-f561-59c4-b604-86ba178dda17, identifier: WK73698
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-28 11:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698 to the API
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:32:18Z',
 'fuel_type': 'diesel',
 'id': '063e5226-f561-59c4-b604-86ba178dda17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK73698',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 307803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-24',
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.de] INFO: Saving data for WK73698: {'auction_closing_time': 1774715538.0, 'created_time': 1774293139.644653, 'last_price_update_time': 1774696175.283183}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK73698') HTTP/1.1" 204 0
2026-03-28 11:09:35 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.de] INFO: Scrape type for PY37454: 2
2026-03-28 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-28 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ca81acb-c9ff-5d2d-9523-136f52758484, identifier: PY37454
2026-03-28 11:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:35 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.de] INFO: Scrape type for MM87204: 2
2026-03-28 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-28 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033d937b-b560-503d-9fd8-7324a44d7e37 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033d937b-b560-503d-9fd8-7324a44d7e37 with scrape type 2
2026-03-28 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033d937b-b560-503d-9fd8-7324a44d7e37, identifier: MM87204
2026-03-28 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-28 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-28 11:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454 to the API
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'diesel',
 'id': '9ca81acb-c9ff-5d2d-9523-136f52758484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY37454',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 170687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-04',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.de] INFO: Saving data for PY37454: {'auction_closing_time': 1774716060.0, 'created_time': 1773741999.456181, 'last_price_update_time': 1774696175.87241}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY37454') HTTP/1.1" 204 0
2026-03-28 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-28 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-28 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204 to the API
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:39:49Z',
 'fuel_type': 'hybrid',
 'id': '033d937b-b560-503d-9fd8-7324a44d7e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM87204',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 299999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-19',
 'seller_name': None,
 'title': 'Toyota Prius 1.5 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2004}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.de] INFO: Saving data for MM87204: {'auction_closing_time': 1774715989.0, 'created_time': 1774377583.78017, 'last_price_update_time': 1774696176.33436}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM87204') HTTP/1.1" 204 0
2026-03-28 11:09:36 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 11:09:36 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-28 11:09:36 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.de] INFO: Scrape type for SX51992: 2
2026-03-28 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-28 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90552867-bda4-5f3a-8027-7ffa30655312, identifier: SX51992
2026-03-28 11:09:36 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 11:09:36 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.de] INFO: Scrape type for DE85774: 2
2026-03-28 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-28 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-28 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f, identifier: DE85774
2026-03-28 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-28 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-28 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992 to the API
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'diesel',
 'id': '90552867-bda4-5f3a-8027-7ffa30655312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX51992',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 153379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2017}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-28 11:09:36 [auto1.de] INFO: Saving data for SX51992: {'auction_closing_time': 1774714609.0, 'created_time': 1773427015.614078, 'last_price_update_time': 1774696176.902863}
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX51992') HTTP/1.1" 204 0
2026-03-28 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-28 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-28 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774 to the API
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:19:53Z',
 'fuel_type': 'petrol',
 'id': '5f46ea9d-e12f-5120-b499-a62ec61d5e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE85774',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 176084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-31',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2009}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.de] INFO: Saving data for DE85774: {'auction_closing_time': 1774714793.0, 'created_time': 1773859923.758039, 'last_price_update_time': 1774696177.269659}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE85774') HTTP/1.1" 204 0
2026-03-28 11:09:37 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.de] INFO: Scrape type for ZA74558: 2
2026-03-28 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-28 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aaabb6-c342-5cb7-aa23-044bcfe32476, identifier: ZA74558
2026-03-28 11:09:37 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 11:09:37 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.de] INFO: Scrape type for XG77480: 2
2026-03-28 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-28 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-28 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338, identifier: XG77480
2026-03-28 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-28 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-28 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558 to the API
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:34Z',
 'fuel_type': 'diesel',
 'id': '15aaabb6-c342-5cb7-aa23-044bcfe32476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA74558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 292487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-28 11:09:37 [auto1.de] INFO: Saving data for ZA74558: {'auction_closing_time': 1774714534.0, 'created_time': 1773776243.486686, 'last_price_update_time': 1774696177.902349}
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA74558') HTTP/1.1" 204 0
2026-03-28 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-28 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'diesel',
 'id': 'f7cd9e71-a84d-59aa-9f21-4ac67d5a0338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG77480',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 222934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.de] INFO: Saving data for XG77480: {'auction_closing_time': 1774716653.0, 'created_time': 1773659518.963642, 'last_price_update_time': 1774696178.225901}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG77480') HTTP/1.1" 204 0
2026-03-28 11:09:38 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.de] INFO: Scrape type for VX77382: 2
2026-03-28 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-28 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac7bd0c-bbae-5215-970b-38dad016a6ba with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac7bd0c-bbae-5215-970b-38dad016a6ba with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ac7bd0c-bbae-5215-970b-38dad016a6ba, identifier: VX77382
2026-03-28 11:09:38 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.de] INFO: Scrape type for LZ09190: 2
2026-03-28 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-28 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-28 11:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf74005e-8341-5543-ac74-cc35eac3da6c, identifier: LZ09190
2026-03-28 11:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-28 11:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:51Z',
 'fuel_type': 'diesel',
 'id': '1ac7bd0c-bbae-5215-970b-38dad016a6ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX77382',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 102399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'automatic',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-28 11:09:38 [auto1.de] INFO: Saving data for VX77382: {'auction_closing_time': 1774716411.0, 'created_time': 1774293078.609282, 'last_price_update_time': 1774696178.756246}
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX77382') HTTP/1.1" 204 0
2026-03-28 11:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-28 11:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-28 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190 to the API
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 271,
 'expiration_date': '2026-03-28T16:36:43Z',
 'fuel_type': 'petrol',
 'id': 'cf74005e-8341-5543-ac74-cc35eac3da6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ09190',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 102704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2021}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Saving data for LZ09190: {'auction_closing_time': 1774715803.0, 'created_time': 1773830088.489627, 'last_price_update_time': 1774696179.044881}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ09190') HTTP/1.1" 204 0
2026-03-28 11:09:39 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Scrape type for KX42000: 2
2026-03-28 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-28 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90829174-e7d4-584c-a331-3ece749f95e0, identifier: KX42000
2026-03-28 11:09:39 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Scrape type for KF55313: 2
2026-03-28 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-28 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3, identifier: KF55313
2026-03-28 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-28 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-28 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000 to the API
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:16:34Z',
 'fuel_type': 'diesel',
 'id': '90829174-e7d4-584c-a331-3ece749f95e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX42000',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 138277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2019}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Saving data for KX42000: {'auction_closing_time': 1774714594.0, 'created_time': 1773427299.012885, 'last_price_update_time': 1774696179.584665}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX42000') HTTP/1.1" 204 0
2026-03-28 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-28 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-28 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313 to the API
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:30:57Z',
 'fuel_type': 'petrol',
 'id': '5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF55313',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 333094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Life Gewinner Caddy',
 'transmission': 'manual',
 'trim': 'Life Gewinner',
 'year': 2009}
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Saving data for KF55313: {'auction_closing_time': 1774715457.0, 'created_time': 1773732645.104751, 'last_price_update_time': 1774696180.003513}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF55313') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for AJ88373: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cb2324e-3a11-5df2-afa9-a0db06eb3189, identifier: AJ88373
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for YU55800: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0916ffe3-44cd-5787-9fca-947f936d4181, identifier: YU55800
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:57:15Z',
 'fuel_type': 'petrol',
 'id': '1cb2324e-3a11-5df2-afa9-a0db06eb3189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ88373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 217602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-28',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Saving data for AJ88373: {'auction_closing_time': 1774717035.0, 'created_time': 1773466636.811886, 'last_price_update_time': 1774696180.510767}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ88373') HTTP/1.1" 204 0
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'petrol',
 'id': '0916ffe3-44cd-5787-9fca-947f936d4181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU55800',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 131884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': None,
 'title': 'Renault Megane 1.2 BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Saving data for YU55800: {'auction_closing_time': 1774714034.0, 'created_time': 1773775657.535171, 'last_price_update_time': 1774696180.843063}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU55800') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for DG23349: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13032e9-8a0b-5300-95cc-42c4ff0eec6d with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b13032e9-8a0b-5300-95cc-42c4ff0eec6d with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b13032e9-8a0b-5300-95cc-42c4ff0eec6d, identifier: DG23349
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for MM23773: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0127fa3-ff0d-57ce-9de3-e733be125e5d, identifier: MM23773
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:30:48Z',
 'fuel_type': 'diesel',
 'id': 'b13032e9-8a0b-5300-95cc-42c4ff0eec6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG23349',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 84027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L2H1 Kasten verglast Life',
 'transmission': 'manual',
 'trim': 'L2H1 Kasten verglast Life',
 'year': 2014}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Saving data for DG23349: {'auction_closing_time': 1774715448.0, 'created_time': 1774608113.046911, 'last_price_update_time': 1774696181.424685}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG23349') HTTP/1.1" 204 0
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:22Z',
 'fuel_type': 'diesel',
 'id': 'b0127fa3-ff0d-57ce-9de3-e733be125e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM23773',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 216498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-10',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Saving data for MM23773: {'auction_closing_time': 1774714522.0, 'created_time': 1774293911.948399, 'last_price_update_time': 1774696181.757402}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM23773') HTTP/1.1" 204 0
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Scrape type for PL78300: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee, identifier: PL78300
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Scrape type for PE27590: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9f8e31a-4bf3-56de-b32f-523fd7d4d402, identifier: PE27590
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:25:15Z',
 'fuel_type': 'petrol',
 'id': '5b682d33-830f-5f43-b6e8-30d2a9a0eaee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL78300',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 182576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Saving data for PL78300: {'auction_closing_time': 1774715115.0, 'created_time': 1774262332.314036, 'last_price_update_time': 1774696182.355207}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL78300') HTTP/1.1" 204 0
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:39:15Z',
 'fuel_type': 'diesel',
 'id': 'e9f8e31a-4bf3-56de-b32f-523fd7d4d402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE27590',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 134934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-19',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi UEFA Euro 2016',
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2016}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Saving data for PE27590: {'auction_closing_time': 1774715955.0, 'created_time': 1773775233.496432, 'last_price_update_time': 1774696182.788172}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE27590') HTTP/1.1" 204 0
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Scrape type for XD56030: 2
2026-03-28 11:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-28 11:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 920fc047-d5f4-5b40-be89-e2eae8ec086d, identifier: XD56030
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:42Z',
 'fuel_type': 'petrol',
 'id': '920fc047-d5f4-5b40-be89-e2eae8ec086d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD56030',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 115828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-17',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Saving data for XD56030: {'auction_closing_time': 1774714902.0, 'created_time': 1773134834.795738, 'last_price_update_time': 1774696183.273684}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD56030') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Scrape type for FF92976: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d049567-ddba-5da5-89b8-ff10d0657ab5, identifier: FF92976
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:27:52Z',
 'fuel_type': 'diesel',
 'id': '2d049567-ddba-5da5-89b8-ff10d0657ab5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF92976',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 307091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2014}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Saving data for FF92976: {'auction_closing_time': 1774715272.0, 'created_time': 1774293527.894637, 'last_price_update_time': 1774696183.702377}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF92976') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Scrape type for CN67479: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f, identifier: CN67479
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:17Z',
 'fuel_type': 'diesel',
 'id': '6221f91d-1ff6-5448-a6b5-d62a28f0ca8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN67479',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 204532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-08',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 HDi L1H1 Tendance',
 'transmission': 'manual',
 'trim': 'L1H1 Tendance',
 'year': 2011}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Saving data for CN67479: {'auction_closing_time': 1774713737.0, 'created_time': 1773662274.904959, 'last_price_update_time': 1774696184.246993}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN67479') HTTP/1.1" 204 0
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Scrape type for UW00779: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e42132ff-3dcd-50f7-9cf1-df0a057dde8c, identifier: UW00779
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:30:55Z',
 'fuel_type': 'diesel',
 'id': 'e42132ff-3dcd-50f7-9cf1-df0a057dde8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW00779',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 391015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Saving data for UW00779: {'auction_closing_time': 1774715455.0, 'created_time': 1773811841.372994, 'last_price_update_time': 1774696184.891084}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW00779') HTTP/1.1" 204 0
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Scrape type for BB05749: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24f0b89b-689c-5307-abde-bbf75fa81151, identifier: BB05749
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 281,
 'expiration_date': '2026-03-28T16:16:24Z',
 'fuel_type': 'petrol',
 'id': '24f0b89b-689c-5307-abde-bbf75fa81151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB05749',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLE-Klasse',
 'odometer': 4900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz CLE-Klasse CLE 300 Mild-Hybrid 4Matic AMG Line '
          'Premium',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line Premium',
 'year': 2024}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Saving data for BB05749: {'auction_closing_time': 1774714584.0, 'created_time': 1773301481.398373, 'last_price_update_time': 1774696185.402183}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB05749') HTTP/1.1" 204 0
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Scrape type for ZX08266: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b042b90d-6e3c-573b-8a81-75093e4b3add, identifier: ZX08266
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:23:07Z',
 'fuel_type': 'petrol',
 'id': 'b042b90d-6e3c-573b-8a81-75093e4b3add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX08266',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 141355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-03',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2019}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Saving data for ZX08266: {'auction_closing_time': 1774714987.0, 'created_time': 1773303507.725137, 'last_price_update_time': 1774696185.911927}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX08266') HTTP/1.1" 204 0
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 11:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:46 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Scrape type for LK12001: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa64b42-65e4-5664-abfa-80a51e1d7c72, identifier: LK12001
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001 to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:49:56Z',
 'fuel_type': 'petrol',
 'id': '4aa64b42-65e4-5664-abfa-80a51e1d7c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12001',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 127275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Saving data for LK12001: {'auction_closing_time': 1774716596.0, 'created_time': 1773775653.956429, 'last_price_update_time': 1774696186.888084}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK12001') HTTP/1.1" 204 0
2026-03-28 11:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Scrape type for AL51386: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 693c97e2-ba08-537b-9fac-d5f53d4e4fca, identifier: AL51386
2026-03-28 11:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-28 11:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-28 11:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386 to the API
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:27:27Z',
 'fuel_type': 'diesel',
 'id': '693c97e2-ba08-537b-9fac-d5f53d4e4fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL51386',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 109660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Saving data for AL51386: {'auction_closing_time': 1774715247.0, 'created_time': 1773688491.508294, 'last_price_update_time': 1774696188.173113}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL51386') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Scrape type for FV26342: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1be89d9f-5d60-5d7a-8895-4cb06c51f066, identifier: FV26342
2026-03-28 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-28 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342 to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:32:37Z',
 'fuel_type': 'diesel',
 'id': '1be89d9f-5d60-5d7a-8895-4cb06c51f066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV26342',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 190760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-12',
 'seller_name': None,
 'title': 'Ford Ranger 2.5 Diesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Saving data for FV26342: {'auction_closing_time': 1774715557.0, 'created_time': 1773830756.372274, 'last_price_update_time': 1774696188.636232}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV26342') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Scrape type for BW77657: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43174215-e98c-5c0d-8275-4abbaf9d486a, identifier: BW77657
2026-03-28 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-28 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657 to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:43:27Z',
 'fuel_type': 'diesel',
 'id': '43174215-e98c-5c0d-8275-4abbaf9d486a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW77657',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 109924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2019}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Saving data for BW77657: {'auction_closing_time': 1774716207.0, 'created_time': 1773830855.84561, 'last_price_update_time': 1774696189.120293}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW77657') HTTP/1.1" 204 0
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Scrape type for BL84965: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97, identifier: BL84965
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:18Z',
 'fuel_type': 'petrol',
 'id': '4841b8a7-b30d-5dcf-bb3d-7925f921ee97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL84965',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 90495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Saving data for BL84965: {'auction_closing_time': 1774715418.0, 'created_time': 1774291200.135366, 'last_price_update_time': 1774696189.605555}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL84965') HTTP/1.1" 204 0
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Scrape type for ML06015: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de114ebc-818a-502f-a40f-d6997410382e, identifier: ML06015
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:51:26Z',
 'fuel_type': 'petrol',
 'id': 'de114ebc-818a-502f-a40f-d6997410382e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML06015',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 64641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2011}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Saving data for ML06015: {'auction_closing_time': 1774716686.0, 'created_time': 1773859275.036936, 'last_price_update_time': 1774696190.049514}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML06015') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Scrape type for NR72053: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dad828b9-221a-5747-9151-5f00fb147548, identifier: NR72053
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-28 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053 to the API
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:13Z',
 'fuel_type': 'diesel',
 'id': 'dad828b9-221a-5747-9151-5f00fb147548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR72053',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 102775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2021}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Saving data for NR72053: {'auction_closing_time': 1774715233.0, 'created_time': 1773304608.75297, 'last_price_update_time': 1774696190.775824}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR72053') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Scrape type for NN07588: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0208e04e-5c56-57ee-a5b5-476f9a4413b7, identifier: NN07588
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'diesel',
 'id': '0208e04e-5c56-57ee-a5b5-476f9a4413b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN07588',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 48503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L1 Kasten Meister',
 'transmission': 'manual',
 'trim': 'L1 Kasten Meister',
 'year': 2019}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Saving data for NN07588: {'auction_closing_time': 1774714429.0, 'created_time': 1774294685.764945, 'last_price_update_time': 1774696191.251458}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN07588') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Scrape type for BD98070: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da481d76-a4db-5111-b8f6-98b933fae6b2, identifier: BD98070
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'petrol',
 'id': 'da481d76-a4db-5111-b8f6-98b933fae6b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD98070',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 22905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Saving data for BD98070: {'auction_closing_time': 1774714809.0, 'created_time': 1773428943.479344, 'last_price_update_time': 1774696191.738462}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD98070') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Scrape type for EL73218: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6b366a2-ee0e-5512-87f3-35fa687c2911, identifier: EL73218
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'diesel',
 'id': 'e6b366a2-ee0e-5512-87f3-35fa687c2911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL73218',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 203512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Saving data for EL73218: {'auction_closing_time': 1774716882.0, 'created_time': 1773308230.640036, 'last_price_update_time': 1774696192.211752}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL73218') HTTP/1.1" 204 0
2026-03-28 11:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Scrape type for BR95231: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03bebd53-3ec3-5991-b70a-5d5cae425a75, identifier: BR95231
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 271,
 'expiration_date': '2026-03-28T16:45:15Z',
 'fuel_type': 'petrol',
 'id': '03bebd53-3ec3-5991-b70a-5d5cae425a75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR95231',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 69320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-15',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2020}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Saving data for BR95231: {'auction_closing_time': 1774716315.0, 'created_time': 1774292812.641651, 'last_price_update_time': 1774696192.850066}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR95231') HTTP/1.1" 204 0
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Scrape type for JX40120: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc, identifier: JX40120
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'petrol',
 'id': '0c244ee9-8569-5fc0-b83f-1d9de43a67dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX40120',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 164263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Saving data for JX40120: {'auction_closing_time': 1774715117.0, 'created_time': 1773776028.889085, 'last_price_update_time': 1774696193.282006}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX40120') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Scrape type for GC03067: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dde58bb-a540-5568-9bfc-591bcadb7d5f, identifier: GC03067
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:48Z',
 'fuel_type': 'diesel',
 'id': '2dde58bb-a540-5568-9bfc-591bcadb7d5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03067',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 196755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement',
 'year': 2021}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Saving data for GC03067: {'auction_closing_time': 1774715988.0, 'created_time': 1773859347.042169, 'last_price_update_time': 1774696193.715868}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC03067') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Scrape type for EV07676: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f214e540-ee7b-5b55-b8b9-18af76159a0e, identifier: EV07676
2026-03-28 11:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Scrape type for XW85438: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed233fae-2093-5187-848c-918828d3cf8d, identifier: XW85438
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:36:54Z',
 'fuel_type': 'diesel',
 'id': 'f214e540-ee7b-5b55-b8b9-18af76159a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV07676',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 146263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Saving data for EV07676: {'auction_closing_time': 1774715814.0, 'created_time': 1773859666.558048, 'last_price_update_time': 1774696194.268128}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV07676') HTTP/1.1" 204 0
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:57:20Z',
 'fuel_type': 'diesel',
 'id': 'ed233fae-2093-5187-848c-918828d3cf8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW85438',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 210445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Toyota Avensis 2.2 D-4D D-Cat Executive Liftback',
 'transmission': 'manual',
 'trim': 'D-Cat Executive Liftback',
 'year': 2007}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Saving data for XW85438: {'auction_closing_time': 1774717040.0, 'created_time': 1774294153.149817, 'last_price_update_time': 1774696194.676711}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW85438') HTTP/1.1" 204 0
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Scrape type for RY40991: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9768452-3008-58e6-8114-16116dd00589 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9768452-3008-58e6-8114-16116dd00589 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9768452-3008-58e6-8114-16116dd00589, identifier: RY40991
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Scrape type for AT56964: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c175e3b6-6fce-521b-92b1-c5b5392ae91e, identifier: AT56964
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:56:41Z',
 'fuel_type': 'petrol',
 'id': 'f9768452-3008-58e6-8114-16116dd00589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY40991',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 234023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-01',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2006}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Saving data for RY40991: {'auction_closing_time': 1774717001.0, 'created_time': 1774330269.300995, 'last_price_update_time': 1774696195.206937}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY40991') HTTP/1.1" 204 0
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:02:21Z',
 'fuel_type': 'diesel',
 'id': 'c175e3b6-6fce-521b-92b1-c5b5392ae91e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT56964',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 185497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Saving data for AT56964: {'auction_closing_time': 1774713741.0, 'created_time': 1774031622.858241, 'last_price_update_time': 1774696195.522304}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT56964') HTTP/1.1" 204 0
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Scrape type for TB03124: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 027adde0-4e65-5bb3-bc37-49fecac89140, identifier: TB03124
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Scrape type for SD97689: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44843c13-7251-5281-b3f8-96ec5eb8a6fa, identifier: SD97689
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:39Z',
 'fuel_type': 'petrol',
 'id': '027adde0-4e65-5bb3-bc37-49fecac89140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB03124',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 37123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Saving data for TB03124: {'auction_closing_time': 1774714539.0, 'created_time': 1773400890.847966, 'last_price_update_time': 1774696196.12218}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB03124') HTTP/1.1" 204 0
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:53:08Z',
 'fuel_type': 'petrol',
 'id': '44843c13-7251-5281-b3f8-96ec5eb8a6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97689',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 62906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Saving data for SD97689: {'auction_closing_time': 1774716788.0, 'created_time': 1773400448.859228, 'last_price_update_time': 1774696196.455312}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97689') HTTP/1.1" 204 0
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Scrape type for NG37948: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f9add73-e214-5282-9ef7-3caf8e81af99, identifier: NG37948
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Scrape type for PN78353: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2882ead9-6548-5a70-b55a-27c3ca669719, identifier: PN78353
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:01:03Z',
 'fuel_type': 'petrol',
 'id': '5f9add73-e214-5282-9ef7-3caf8e81af99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG37948',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 33603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2014}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for NG37948: {'auction_closing_time': 1774713663.0, 'created_time': 1773686200.167837, 'last_price_update_time': 1774696197.036686}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG37948') HTTP/1.1" 204 0
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:22:28Z',
 'fuel_type': 'diesel',
 'id': '2882ead9-6548-5a70-b55a-27c3ca669719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN78353',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 240723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-24',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for PN78353: {'auction_closing_time': 1774714948.0, 'created_time': 1772542908.176571, 'last_price_update_time': 1774696197.349476}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN78353') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Scrape type for YH81029: 2
2026-03-28 11:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-28 11:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d, identifier: YH81029
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:53:35Z',
 'fuel_type': 'diesel',
 'id': 'fcf3a7a7-47d6-538c-aa4a-bbc0b712916d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH81029',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 343530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 250 d Shooting Brake 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC',
 'year': 2015}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for YH81029: {'auction_closing_time': 1774716815.0, 'created_time': 1774330253.387537, 'last_price_update_time': 1774696197.797651}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH81029') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Scrape type for JG82377: 2
2026-03-28 11:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-28 11:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8782c6e8-24fc-5985-b70a-74fd2779b13b, identifier: JG82377
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:11:47Z',
 'fuel_type': 'petrol',
 'id': '8782c6e8-24fc-5985-b70a-74fd2779b13b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG82377',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 252141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Saving data for JG82377: {'auction_closing_time': 1774714307.0, 'created_time': 1773340715.593671, 'last_price_update_time': 1774696198.326963}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG82377') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Scrape type for LF15442: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d8a1e38-17c9-54b9-8f4c-3c3262128163, identifier: LF15442
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:25Z',
 'fuel_type': 'diesel',
 'id': '9d8a1e38-17c9-54b9-8f4c-3c3262128163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF15442',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 201291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Saving data for LF15442: {'auction_closing_time': 1774716985.0, 'created_time': 1773426875.995379, 'last_price_update_time': 1774696198.75673}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF15442') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Scrape type for WG70910: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5487ad7d-755c-502f-a860-25a0c4077329, identifier: WG70910
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:50Z',
 'fuel_type': 'diesel',
 'id': '5487ad7d-755c-502f-a860-25a0c4077329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG70910',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 155652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Saving data for WG70910: {'auction_closing_time': 1774717010.0, 'created_time': 1773304018.839119, 'last_price_update_time': 1774696199.154705}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG70910') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Scrape type for ZH54779: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dd22ef7-37f7-5119-87f4-68fd0aac645b, identifier: ZH54779
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:14:13Z',
 'fuel_type': 'diesel',
 'id': '5dd22ef7-37f7-5119-87f4-68fd0aac645b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH54779',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 172250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Saving data for ZH54779: {'auction_closing_time': 1774714453.0, 'created_time': 1774262583.119828, 'last_price_update_time': 1774696199.602322}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH54779') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Scrape type for GE03555: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46f65665-6969-5f21-832f-dc573bc57bd0, identifier: GE03555
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:41:09Z',
 'fuel_type': 'petrol',
 'id': '46f65665-6969-5f21-832f-dc573bc57bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE03555',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for GE03555: {'auction_closing_time': 1774716069.0, 'created_time': 1773133819.095419, 'last_price_update_time': 1774696200.053848}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE03555') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Scrape type for YY49162: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9, identifier: YY49162
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:42Z',
 'fuel_type': 'diesel',
 'id': 'a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY49162',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 149561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2018}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for YY49162: {'auction_closing_time': 1774715622.0, 'created_time': 1773686500.708663, 'last_price_update_time': 1774696200.502958}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY49162') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Scrape type for HT64251: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfedd978-7f38-5581-b144-809649f3d32a, identifier: HT64251
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:16:11Z',
 'fuel_type': 'diesel',
 'id': 'dfedd978-7f38-5581-b144-809649f3d32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT64251',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 224712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for HT64251: {'auction_closing_time': 1774714571.0, 'created_time': 1773400607.006065, 'last_price_update_time': 1774696200.955787}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT64251') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Scrape type for JL85877: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ad86a0-6ed1-530a-b59e-086a73c4447a, identifier: JL85877
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:22:38Z',
 'fuel_type': 'petrol',
 'id': '43ad86a0-6ed1-530a-b59e-086a73c4447a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL85877',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 12895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Saving data for JL85877: {'auction_closing_time': 1774714958.0, 'created_time': 1774292599.413499, 'last_price_update_time': 1774696201.55979}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL85877') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Scrape type for EC36203: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631a612a-b7d8-5e0d-ae7c-af169ef29462, identifier: EC36203
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:00:34Z',
 'fuel_type': 'diesel',
 'id': '631a612a-b7d8-5e0d-ae7c-af169ef29462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC36203',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 139364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI 4Motion',
 'transmission': 'manual',
 'trim': '4Motion',
 'year': 2014}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Saving data for EC36203: {'auction_closing_time': 1774713634.0, 'created_time': 1773429006.578121, 'last_price_update_time': 1774696202.048998}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC36203') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Scrape type for JC56914: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9f453b0-4262-5a01-94f8-04a0d80dbf06, identifier: JC56914
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:46:54Z',
 'fuel_type': 'diesel',
 'id': 'c9f453b0-4262-5a01-94f8-04a0d80dbf06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC56914',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 223190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Saving data for JC56914: {'auction_closing_time': 1774716414.0, 'created_time': 1774262880.570923, 'last_price_update_time': 1774696202.489249}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC56914') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Scrape type for LU78971: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d82731f0-4143-5c3b-bca4-73e350b68a34, identifier: LU78971
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'diesel',
 'id': 'd82731f0-4143-5c3b-bca4-73e350b68a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU78971',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 288720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Saving data for LU78971: {'auction_closing_time': 1774714523.0, 'created_time': 1773469111.327448, 'last_price_update_time': 1774696202.938519}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU78971') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Scrape type for PW95662: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d, identifier: PW95662
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': '5bf2417c-0cff-5bb8-a916-0e6349fdea4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW95662',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 103250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Saving data for PW95662: {'auction_closing_time': 1774713997.0, 'created_time': 1773138237.223613, 'last_price_update_time': 1774696203.46214}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW95662') HTTP/1.1" 204 0
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Scrape type for MW62166: 2
2026-03-28 11:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-28 11:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b1cf2-2975-555c-b977-9137d4923e9f, identifier: MW62166
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:50Z',
 'fuel_type': 'petrol',
 'id': '321b1cf2-2975-555c-b977-9137d4923e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW62166',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 85435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Saving data for MW62166: {'auction_closing_time': 1774715750.0, 'created_time': 1773859537.83337, 'last_price_update_time': 1774696203.98936}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW62166') HTTP/1.1" 204 0
2026-03-28 11:10:04 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 11:10:04 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Scrape type for EV99140: 2
2026-03-28 11:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-28 11:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb54719f-86a4-5e42-a83e-6bab6439cc75, identifier: EV99140
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-28 11:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140 to the API
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:43Z',
 'fuel_type': 'petrol',
 'id': 'cb54719f-86a4-5e42-a83e-6bab6439cc75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV99140',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 102162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Saving data for EV99140: {'auction_closing_time': 1774715503.0, 'created_time': 1773774569.567171, 'last_price_update_time': 1774696204.705865}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV99140') HTTP/1.1" 204 0
2026-03-28 11:10:04 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Scrape type for BP82527: 2
2026-03-28 11:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-28 11:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6, identifier: BP82527
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-28 11:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527 to the API
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:29Z',
 'fuel_type': 'petrol',
 'id': '2971d5f5-254c-5ec8-88df-8f77b49a5bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP82527',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 127416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2006}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.de] INFO: Saving data for BP82527: {'auction_closing_time': 1774713869.0, 'created_time': 1773860369.694964, 'last_price_update_time': 1774696205.17363}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP82527') HTTP/1.1" 204 0
2026-03-28 11:10:05 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.de] INFO: Scrape type for CA11296: 2
2026-03-28 11:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-28 11:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82afe9ad-83dc-5500-9c19-691a6d0092e6, identifier: CA11296
2026-03-28 11:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-28 11:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-28 11:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296 to the API
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:16:12Z',
 'fuel_type': 'diesel',
 'id': '82afe9ad-83dc-5500-9c19-691a6d0092e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA11296',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 191595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.de] INFO: Saving data for CA11296: {'auction_closing_time': 1774714572.0, 'created_time': 1774263166.514422, 'last_price_update_time': 1774696205.673558}
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA11296') HTTP/1.1" 204 0
2026-03-28 11:10:05 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 11:10:05 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-28 11:10:05 [auto1.de] INFO: Scrape type for LP67164: 2
2026-03-28 11:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-28 11:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-28 11:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b22a011-37d1-58d3-830f-3caee704e09f, identifier: LP67164
2026-03-28 11:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-28 11:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164 to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-28T16:09:22Z',
 'fuel_type': 'petrol',
 'id': '9b22a011-37d1-58d3-830f-3caee704e09f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP67164',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 69589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.de] INFO: Saving data for LP67164: {'auction_closing_time': 1774714162.0, 'created_time': 1774294549.272413, 'last_price_update_time': 1774696206.177136}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP67164') HTTP/1.1" 204 0
2026-03-28 11:10:06 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.de] INFO: Scrape type for LT72401: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9c18c-fc62-57c5-940b-b10fe2d77b38, identifier: LT72401
2026-03-28 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-28 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401 to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:57:49Z',
 'fuel_type': 'petrol',
 'id': '10f9c18c-fc62-57c5-940b-b10fe2d77b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT72401',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 121290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-13',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Active Start/Stop',
 'transmission': 'manual',
 'trim': 'Active Start/Stop',
 'year': 2017}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.de] INFO: Saving data for LT72401: {'auction_closing_time': 1774717069.0, 'created_time': 1773305828.571073, 'last_price_update_time': 1774696206.590775}
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT72401') HTTP/1.1" 204 0
2026-03-28 11:10:06 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [auto1.de] INFO: Scrape type for JV37620: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48682df9-ad7a-598c-bbfe-9eca263cfed2, identifier: JV37620
2026-03-28 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-28 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620 to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:10:15Z',
 'fuel_type': 'diesel',
 'id': '48682df9-ad7a-598c-bbfe-9eca263cfed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV37620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 246377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.de] INFO: Saving data for JV37620: {'auction_closing_time': 1774714215.0, 'created_time': 1773305735.521012, 'last_price_update_time': 1774696207.039655}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV37620') HTTP/1.1" 204 0
2026-03-28 11:10:07 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 11:10:07 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.de] INFO: Scrape type for LA05422: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b, identifier: LA05422
2026-03-28 11:10:07 [scrapy.extensions.logstats] INFO: Crawled 435 pages (at 5 pages/min), scraped 897 items (at 99 items/min)
2026-03-28 11:10:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-28 11:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422 to the API
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:50:03Z',
 'fuel_type': 'diesel',
 'id': '40789099-ae02-54ba-adc5-b5b6a8b6bb4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA05422',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 210612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-10',
 'seller_name': None,
 'title': 'BMW 5er 530d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.de] INFO: Saving data for LA05422: {'auction_closing_time': 1774716603.0, 'created_time': 1773307435.14539, 'last_price_update_time': 1774696207.484129}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA05422') HTTP/1.1" 204 0
2026-03-28 11:10:07 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 11:10:07 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.de] INFO: Scrape type for XN26192: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3, identifier: XN26192
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-28 11:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192 to the API
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:56Z',
 'fuel_type': 'diesel',
 'id': 'a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26192',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 228004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [auto1.de] INFO: Saving data for XN26192: {'auction_closing_time': 1774714916.0, 'created_time': 1773830829.297293, 'last_price_update_time': 1774696207.939614}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26192') HTTP/1.1" 204 0
2026-03-28 11:11:06 [scrapy.extensions.logstats] INFO: Crawled 435 pages (at 0 pages/min), scraped 899 items (at 2 items/min)
2026-03-28 11:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:12:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.209(s), this was the 1st time calling it.
2026-03-28 11:12:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.343208519682854 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 11:12:06 [scrapy.extensions.logstats] INFO: Crawled 435 pages (at 0 pages/min), scraped 899 items (at 0 items/min)
2026-03-28 11:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 11:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:13 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Scrape type for TJ09014: 2
2026-03-28 11:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-28 11:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc1c64b5-5d1d-515f-935e-e862c2967eb0, identifier: TJ09014
2026-03-28 11:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-28 11:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-28 11:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014 to the API
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'gas',
 'id': 'bc1c64b5-5d1d-515f-935e-e862c2967eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ09014',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 18617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Saving data for TJ09014: {'auction_closing_time': 1774714953.0, 'created_time': 1774293516.267784, 'last_price_update_time': 1774696334.17661}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ09014') HTTP/1.1" 204 0
2026-03-28 11:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Scrape type for NX72393: 2
2026-03-28 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-28 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a, identifier: NX72393
2026-03-28 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-28 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-28 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393 to the API
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:32:15Z',
 'fuel_type': 'diesel',
 'id': '9dd84191-b856-5b15-9ba4-bf04d1a0ca9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX72393',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 119166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Saving data for NX72393: {'auction_closing_time': 1774715535.0, 'created_time': 1773400932.846374, 'last_price_update_time': 1774696334.620301}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX72393') HTTP/1.1" 204 0
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Scrape type for KV75239: 2
2026-03-28 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-28 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea, identifier: KV75239
2026-03-28 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-28 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-28 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239 to the API
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:14:15Z',
 'fuel_type': 'petrol',
 'id': '82444e8b-ca76-5e97-8ad8-4ee35d3e8cea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV75239',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 213705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2009}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Saving data for KV75239: {'auction_closing_time': 1774714455.0, 'created_time': 1773306810.208658, 'last_price_update_time': 1774696335.058076}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV75239') HTTP/1.1" 204 0
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Scrape type for SV37503: 2
2026-03-28 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-28 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a6c93f-6dcb-5cde-b2e2-506bb6118118, identifier: SV37503
2026-03-28 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-28 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-28 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503 to the API
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:21Z',
 'fuel_type': 'diesel',
 'id': '76a6c93f-6dcb-5cde-b2e2-506bb6118118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV37503',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 217870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Saving data for SV37503: {'auction_closing_time': 1774714641.0, 'created_time': 1773305142.114816, 'last_price_update_time': 1774696335.456104}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV37503') HTTP/1.1" 204 0
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Scrape type for XG51341: 2
2026-03-28 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-28 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a76675-8238-50c3-8d59-2182802745f4, identifier: XG51341
2026-03-28 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-28 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-28 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341 to the API
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:48Z',
 'fuel_type': 'diesel',
 'id': 'e1a76675-8238-50c3-8d59-2182802745f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG51341',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 132343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Saving data for XG51341: {'auction_closing_time': 1774714068.0, 'created_time': 1773305529.269679, 'last_price_update_time': 1774696335.869056}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG51341') HTTP/1.1" 204 0
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Scrape type for EU55937: 2
2026-03-28 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-28 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d1bd06-228a-5b68-952d-698deb89dc78, identifier: EU55937
2026-03-28 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-28 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-28 11:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937 to the API
2026-03-28 11:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:22Z',
 'fuel_type': 'diesel',
 'id': '79d1bd06-228a-5b68-952d-698deb89dc78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU55937',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 157214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D2 Linje Classic',
 'transmission': 'manual',
 'trim': 'Linje Classic',
 'year': 2015}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Saving data for EU55937: {'auction_closing_time': 1774714462.0, 'created_time': 1774290700.149568, 'last_price_update_time': 1774696337.280324}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU55937') HTTP/1.1" 204 0
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Scrape type for BF85943: 2
2026-03-28 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-28 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba42525d-36c6-5ad9-9430-e809d1e47c8a, identifier: BF85943
2026-03-28 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-28 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-28 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943 to the API
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:58Z',
 'fuel_type': 'diesel',
 'id': 'ba42525d-36c6-5ad9-9430-e809d1e47c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF85943',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 150257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Saving data for BF85943: {'auction_closing_time': 1774714978.0, 'created_time': 1773303743.454613, 'last_price_update_time': 1774696337.696517}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF85943') HTTP/1.1" 204 0
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Scrape type for NS04983: 2
2026-03-28 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-28 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5107a15a-289f-5118-821d-0e47c7fd0497, identifier: NS04983
2026-03-28 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-28 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983 to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:15:21Z',
 'fuel_type': 'petrol',
 'id': '5107a15a-289f-5118-821d-0e47c7fd0497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS04983',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 67979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 28i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Saving data for NS04983: {'auction_closing_time': 1774714521.0, 'created_time': 1773400577.900967, 'last_price_update_time': 1774696338.24512}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS04983') HTTP/1.1" 204 0
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Scrape type for GH47357: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f140020-f7fe-5db7-9562-be06624fa3c6, identifier: GH47357
2026-03-28 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-28 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357 to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'petrol',
 'id': '9f140020-f7fe-5db7-9562-be06624fa3c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH47357',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 63401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Saving data for GH47357: {'auction_closing_time': 1774716591.0, 'created_time': 1774294279.005732, 'last_price_update_time': 1774696338.716081}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH47357') HTTP/1.1" 204 0
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Scrape type for CA65369: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1, identifier: CA65369
2026-03-28 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-28 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369 to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'petrol',
 'id': '6f2a883d-36f1-5cb8-9b78-ac7715eef8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA65369',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 102905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Saving data for CA65369: {'auction_closing_time': 1774714267.0, 'created_time': 1773399912.007961, 'last_price_update_time': 1774696339.148642}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA65369') HTTP/1.1" 204 0
2026-03-28 11:12:19 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Scrape type for BD43064: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9b4c7af-39c1-50a8-830b-407d7c60fdf5, identifier: BD43064
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064 to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:07:08Z',
 'fuel_type': 'petrol',
 'id': 'e9b4c7af-39c1-50a8-830b-407d7c60fdf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD43064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 101599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Saving data for BD43064: {'auction_closing_time': 1774714028.0, 'created_time': 1773305440.876803, 'last_price_update_time': 1774696339.587948}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD43064') HTTP/1.1" 204 0
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Scrape type for WB73740: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27ca45c5-ea7d-5329-b358-03aea19176a3, identifier: WB73740
2026-03-28 11:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Scrape type for UF29194: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07eda542-d003-50c0-acf9-c56bfae8e648, identifier: UF29194
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740 to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'petrol',
 'id': '27ca45c5-ea7d-5329-b358-03aea19176a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB73740',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 79326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-08',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2018}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Saving data for WB73740: {'auction_closing_time': 1774715222.0, 'created_time': 1773775263.523724, 'last_price_update_time': 1774696340.148391}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB73740') HTTP/1.1" 204 0
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194 to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:18Z',
 'fuel_type': 'diesel',
 'id': '07eda542-d003-50c0-acf9-c56bfae8e648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF29194',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 59601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-16',
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI I-Tech Ecomotive',
 'transmission': 'manual',
 'trim': 'I-Tech Ecomotive',
 'year': 2015}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Saving data for UF29194: {'auction_closing_time': 1774716018.0, 'created_time': 1773305086.134765, 'last_price_update_time': 1774696340.525393}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF29194') HTTP/1.1" 204 0
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Scrape type for CN87800: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda, identifier: CN87800
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Scrape type for GV91786: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf668407-154f-5b4a-a50e-a5a0cf8951ce, identifier: GV91786
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800 to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:44:16Z',
 'fuel_type': 'diesel',
 'id': '3ba28a4f-6003-5c2d-9a1d-801c29d22cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN87800',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 125367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'BMW X5 sDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Saving data for CN87800: {'auction_closing_time': 1774716256.0, 'created_time': 1773399939.317202, 'last_price_update_time': 1774696341.093558}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN87800') HTTP/1.1" 204 0
2026-03-28 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-28 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-28 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786 to the API
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:50:36Z',
 'fuel_type': 'diesel',
 'id': 'bf668407-154f-5b4a-a50e-a5a0cf8951ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91786',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 192561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Saving data for GV91786: {'auction_closing_time': 1774716636.0, 'created_time': 1774251087.062071, 'last_price_update_time': 1774696341.443808}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91786') HTTP/1.1" 204 0
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Scrape type for NF34057: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139, identifier: NF34057
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Scrape type for TN59671: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b77b7246-133a-54c3-a584-c26e7a6c0d04, identifier: TN59671
2026-03-28 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-28 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-28 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057 to the API
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:43Z',
 'fuel_type': 'diesel',
 'id': '2428d9c9-6af0-539c-9ca4-87e6c0e8a139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF34057',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 98049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2013}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Saving data for NF34057: {'auction_closing_time': 1774715143.0, 'created_time': 1773427875.674524, 'last_price_update_time': 1774696341.988937}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF34057') HTTP/1.1" 204 0
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671 to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:59:00Z',
 'fuel_type': 'diesel',
 'id': 'b77b7246-133a-54c3-a584-c26e7a6c0d04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN59671',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 76670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seller_name': None,
 'title': 'Iveco Daily 3.0 Diesel Einzelkabine 70 C Radstand 4350',
 'transmission': 'manual',
 'trim': 'Einzelkabine 70 C Radstand 4350',
 'year': 2021}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Saving data for TN59671: {'auction_closing_time': 1774717140.0, 'created_time': 1773917538.259573, 'last_price_update_time': 1774696342.401358}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN59671') HTTP/1.1" 204 0
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Scrape type for AW17852: 2
2026-03-28 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-28 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c8e0ef-26cb-54d3-8803-0458b7249a7d, identifier: AW17852
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Scrape type for GK53222: 2
2026-03-28 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-28 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f6b90a9-f227-5897-8d1f-0d66eacebe13, identifier: GK53222
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852 to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:23Z',
 'fuel_type': 'diesel',
 'id': '50c8e0ef-26cb-54d3-8803-0458b7249a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17852',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 169832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Saving data for AW17852: {'auction_closing_time': 1774716143.0, 'created_time': 1774292936.926799, 'last_price_update_time': 1774696342.955712}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW17852') HTTP/1.1" 204 0
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:27Z',
 'fuel_type': 'petrol',
 'id': '4f6b90a9-f227-5897-8d1f-0d66eacebe13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK53222',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 61292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Saving data for GK53222: {'auction_closing_time': 1774714707.0, 'created_time': 1773776049.702604, 'last_price_update_time': 1774696343.272838}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK53222') HTTP/1.1" 204 0
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Scrape type for ZK30866: 2
2026-03-28 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-28 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08, identifier: ZK30866
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Scrape type for GK41748: 2
2026-03-28 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-28 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d14ed150-6733-590a-9ba9-8133d7a03997, identifier: GK41748
2026-03-28 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-28 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:37:10Z',
 'fuel_type': 'petrol',
 'id': '0b023f2a-c1e8-51e6-8a83-aa8e03e50f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK30866',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 97552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-12',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Saving data for ZK30866: {'auction_closing_time': 1774715830.0, 'created_time': 1773686588.289577, 'last_price_update_time': 1774696343.838121}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK30866') HTTP/1.1" 204 0
2026-03-28 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-28 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:30:44Z',
 'fuel_type': 'petrol',
 'id': 'd14ed150-6733-590a-9ba9-8133d7a03997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK41748',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 217622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-09',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Compact TS',
 'transmission': 'manual',
 'trim': 'Compact TS',
 'year': 2002}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Saving data for GK41748: {'auction_closing_time': 1774715444.0, 'created_time': 1773302964.758846, 'last_price_update_time': 1774696344.173967}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK41748') HTTP/1.1" 204 0
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Scrape type for YS21206: 2
2026-03-28 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-28 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4009654-c333-5c68-9d3a-c1b1b92c5cfa, identifier: YS21206
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB73186%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Scrape type for LB73186: 0
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Scrape type for NC65519: 2
2026-03-28 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-28 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1457ace6-b797-5441-a90c-31a7ea8eaed2, identifier: NC65519
2026-03-28 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-28 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-28 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206 to the API
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:01:38Z',
 'fuel_type': 'diesel',
 'id': 'f4009654-c333-5c68-9d3a-c1b1b92c5cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS21206',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 251704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Saving data for YS21206: {'auction_closing_time': 1774713698.0, 'created_time': 1774292686.376603, 'last_price_update_time': 1774696344.76027}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS21206') HTTP/1.1" 204 0
2026-03-28 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-28 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-28 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519 to the API
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:45:09Z',
 'fuel_type': 'petrol',
 'id': '1457ace6-b797-5441-a90c-31a7ea8eaed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC65519',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 117681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2016}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Saving data for NC65519: {'auction_closing_time': 1774716309.0, 'created_time': 1773308158.323328, 'last_price_update_time': 1774696345.158411}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC65519') HTTP/1.1" 204 0
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Scrape type for VC63070: 2
2026-03-28 11:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-28 11:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d28c24-e7ec-502e-bf8a-e3cad0aded94, identifier: VC63070
2026-03-28 11:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-28 11:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-28 11:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070 to the API
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:42:49Z',
 'fuel_type': 'diesel',
 'id': 'a2d28c24-e7ec-502e-bf8a-e3cad0aded94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC63070',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 121427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-17',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Trend blue 2WD',
 'transmission': 'manual',
 'trim': 'Trend blue 2WD',
 'year': 2018}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Saving data for VC63070: {'auction_closing_time': 1774716169.0, 'created_time': 1773775438.495913, 'last_price_update_time': 1774696345.645502}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC63070') HTTP/1.1" 204 0
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Scrape type for RS52465: 2
2026-03-28 11:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-28 11:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872c3017-0b3c-54e7-983e-91275867c156, identifier: RS52465
2026-03-28 11:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-28 11:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-28 11:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465 to the API
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:57:22Z',
 'fuel_type': 'petrol',
 'id': '872c3017-0b3c-54e7-983e-91275867c156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52465',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 109869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Saving data for RS52465: {'auction_closing_time': 1774717042.0, 'created_time': 1773427714.732821, 'last_price_update_time': 1774696346.182392}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52465') HTTP/1.1" 204 0
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Scrape type for ME69590: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01909457-3e7f-57c6-995b-5a5fb67a33cc with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01909457-3e7f-57c6-995b-5a5fb67a33cc with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01909457-3e7f-57c6-995b-5a5fb67a33cc, identifier: ME69590
2026-03-28 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-28 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-28 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590 to the API
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:52Z',
 'fuel_type': 'diesel',
 'id': '01909457-3e7f-57c6-995b-5a5fb67a33cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME69590',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 151005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Saving data for ME69590: {'auction_closing_time': 1774714852.0, 'created_time': 1774608210.699593, 'last_price_update_time': 1774696346.654566}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME69590') HTTP/1.1" 204 0
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Scrape type for FK93583: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88388082-6f36-5a88-82b9-af9197ffe1f9, identifier: FK93583
2026-03-28 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-28 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-28 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583 to the API
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:16:14Z',
 'fuel_type': 'petrol',
 'id': '88388082-6f36-5a88-82b9-af9197ffe1f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK93583',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 165875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Saving data for FK93583: {'auction_closing_time': 1774714574.0, 'created_time': 1773776244.391065, 'last_price_update_time': 1774696347.110477}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK93583') HTTP/1.1" 204 0
2026-03-28 11:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Scrape type for YF25460: 2
2026-03-28 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-28 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db0a03e-3685-57f7-b0de-67562b6f97a2, identifier: YF25460
2026-03-28 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-28 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-28 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460 to the API
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:33Z',
 'fuel_type': 'petrol',
 'id': '3db0a03e-3685-57f7-b0de-67562b6f97a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF25460',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 122225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Saving data for YF25460: {'auction_closing_time': 1774716333.0, 'created_time': 1773773704.188081, 'last_price_update_time': 1774696347.64381}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF25460') HTTP/1.1" 204 0
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Scrape type for NM28513: 2
2026-03-28 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-28 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e480f60-9e0a-54e9-9f8c-1187b63333da, identifier: NM28513
2026-03-28 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-28 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-28 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513 to the API
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'petrol',
 'id': '1e480f60-9e0a-54e9-9f8c-1187b63333da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM28513',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 70700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Saving data for NM28513: {'auction_closing_time': 1774713711.0, 'created_time': 1773830816.714578, 'last_price_update_time': 1774696348.1372}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM28513') HTTP/1.1" 204 0
2026-03-28 11:12:28 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 9710 | hits on page: 40
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Scrape type for YT48598: 2
2026-03-28 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-28 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc852cd7-f6d5-5406-addd-ead2b27c816b, identifier: YT48598
2026-03-28 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-28 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-28 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598 to the API
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-28T16:30:31Z',
 'fuel_type': 'petrol',
 'id': 'cc852cd7-f6d5-5406-addd-ead2b27c816b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT48598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 228128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2013}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Saving data for YT48598: {'auction_closing_time': 1774715431.0, 'created_time': 1773688627.535516, 'last_price_update_time': 1774696348.648485}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT48598') HTTP/1.1" 204 0
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Scrape type for PL89727: 2
2026-03-28 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-28 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b, identifier: PL89727
2026-03-28 11:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Scrape type for XY70185: 2
2026-03-28 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-28 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4f42c70-f1cd-555e-931f-ce1c7966d398, identifier: XY70185
2026-03-28 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-28 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-28 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727 to the API
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:09:37Z',
 'fuel_type': 'diesel',
 'id': 'a7bb5e19-d667-5aa4-b5b4-efe0be29c07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL89727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 99632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Saving data for PL89727: {'auction_closing_time': 1774714177.0, 'created_time': 1773400140.066234, 'last_price_update_time': 1774696349.173692}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL89727') HTTP/1.1" 204 0
2026-03-28 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-28 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-28 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185 to the API
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:09:24Z',
 'fuel_type': 'diesel',
 'id': 'b4f42c70-f1cd-555e-931f-ce1c7966d398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY70185',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 153718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style Plus',
 'transmission': 'automatic',
 'trim': 'Style Plus',
 'year': 2016}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Saving data for XY70185: {'auction_closing_time': 1774714164.0, 'created_time': 1773830936.852536, 'last_price_update_time': 1774696349.609954}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY70185') HTTP/1.1" 204 0
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Scrape type for LK50983: 2
2026-03-28 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-28 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcdbe8d-42d1-5742-855a-630cd76717f4, identifier: LK50983
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Scrape type for YW59624: 2
2026-03-28 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-28 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5, identifier: YW59624
2026-03-28 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-28 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-28 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983 to the API
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:26:45Z',
 'fuel_type': 'diesel',
 'id': '8dcdbe8d-42d1-5742-855a-630cd76717f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK50983',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 296859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-02',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2004}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Saving data for LK50983: {'auction_closing_time': 1774715205.0, 'created_time': 1774291163.056043, 'last_price_update_time': 1774696350.194181}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK50983') HTTP/1.1" 204 0
2026-03-28 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-28 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624 to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:57Z',
 'fuel_type': 'diesel',
 'id': '3b0691bd-ee90-5b91-b7ad-c61d5361e0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW59624',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 127313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-23',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Saving data for YW59624: {'auction_closing_time': 1774717197.0, 'created_time': 1773305608.460951, 'last_price_update_time': 1774696350.502603}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW59624') HTTP/1.1" 204 0
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Scrape type for EF84485: 2
2026-03-28 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-28 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c982a3e-2731-5426-8c0b-064a6c424c1f, identifier: EF84485
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Scrape type for RG82987: 2
2026-03-28 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-28 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedadf5a-19d1-5b22-86f1-abf3d074c0b4, identifier: RG82987
2026-03-28 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-28 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485 to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:15Z',
 'fuel_type': 'diesel',
 'id': '0c982a3e-2731-5426-8c0b-064a6c424c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF84485',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 CDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2001}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Saving data for EF84485: {'auction_closing_time': 1774714935.0, 'created_time': 1773303603.844099, 'last_price_update_time': 1774696351.323465}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF84485') HTTP/1.1" 204 0
2026-03-28 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-28 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-28 11:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987 to the API
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:03Z',
 'fuel_type': 'diesel',
 'id': 'bedadf5a-19d1-5b22-86f1-abf3d074c0b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG82987',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 309702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-05',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Saving data for RG82987: {'auction_closing_time': 1774714623.0, 'created_time': 1773400574.297106, 'last_price_update_time': 1774696351.644145}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG82987') HTTP/1.1" 204 0
2026-03-28 11:12:31 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Scrape type for SP58738: 2
2026-03-28 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-28 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74a6fe0-2110-5290-9e66-3f606decf6a8 with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f74a6fe0-2110-5290-9e66-3f606decf6a8 with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f74a6fe0-2110-5290-9e66-3f606decf6a8, identifier: SP58738
2026-03-28 11:12:31 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Scrape type for MG28857: 2
2026-03-28 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-28 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7b2ff8-dfd6-5474-a272-fc07e37979fd, identifier: MG28857
2026-03-28 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-28 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738 to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:54:00Z',
 'fuel_type': 'petrol',
 'id': 'f74a6fe0-2110-5290-9e66-3f606decf6a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP58738',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 92765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-15',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Saving data for SP58738: {'auction_closing_time': 1774716840.0, 'created_time': 1773224305.397775, 'last_price_update_time': 1774696352.205544}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP58738') HTTP/1.1" 204 0
2026-03-28 11:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-28 11:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857 to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-28T16:20:24Z',
 'fuel_type': 'petrol',
 'id': 'bb7b2ff8-dfd6-5474-a272-fc07e37979fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG28857',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 178285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'Porsche Cayenne GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Saving data for MG28857: {'auction_closing_time': 1774714824.0, 'created_time': 1773340408.249628, 'last_price_update_time': 1774696352.721012}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG28857') HTTP/1.1" 204 0
2026-03-28 11:12:32 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Scrape type for TZ19731: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753, identifier: TZ19731
2026-03-28 11:12:32 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Scrape type for JT86021: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e47556c7-d40c-5641-926a-3f9b6726671f, identifier: JT86021
2026-03-28 11:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-28 11:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-28 11:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731 to the API
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:41Z',
 'fuel_type': 'diesel',
 'id': '03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ19731',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 239148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Saving data for TZ19731: {'auction_closing_time': 1774716641.0, 'created_time': 1774034321.32657, 'last_price_update_time': 1774696353.344458}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ19731') HTTP/1.1" 204 0
2026-03-28 11:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-28 11:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-28 11:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021 to the API
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:26:44Z',
 'fuel_type': 'diesel',
 'id': 'e47556c7-d40c-5641-926a-3f9b6726671f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT86021',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 166403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Jaguar XF 30d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2016}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Saving data for JT86021: {'auction_closing_time': 1774715204.0, 'created_time': 1773302801.647291, 'last_price_update_time': 1774696353.685914}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT86021') HTTP/1.1" 204 0
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Scrape type for VW82123: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed0903ec-f813-5d44-879b-644bcd7995e1, identifier: VW82123
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Scrape type for PL48246: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6, identifier: PL48246
2026-03-28 11:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-28 11:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-28 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123 to the API
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:47:05Z',
 'fuel_type': 'diesel',
 'id': 'ed0903ec-f813-5d44-879b-644bcd7995e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW82123',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 117396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Saving data for VW82123: {'auction_closing_time': 1774716425.0, 'created_time': 1773830887.628403, 'last_price_update_time': 1774696354.25668}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW82123') HTTP/1.1" 204 0
2026-03-28 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-28 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-28 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246 to the API
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:37Z',
 'fuel_type': 'petrol',
 'id': '016cb832-c848-5eb9-ad0c-7a8fe7acb9c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL48246',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 82976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2019}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Saving data for PL48246: {'auction_closing_time': 1774717057.0, 'created_time': 1772543840.915684, 'last_price_update_time': 1774696354.620956}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL48246') HTTP/1.1" 204 0
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Scrape type for RP50374: 2
2026-03-28 11:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-28 11:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c083207e-7ddf-5cb1-a4f9-d1ad6373808a, identifier: RP50374
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Scrape type for LC91854: 2
2026-03-28 11:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-28 11:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d, identifier: LC91854
2026-03-28 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-28 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-28 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374 to the API
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'diesel',
 'id': 'c083207e-7ddf-5cb1-a4f9-d1ad6373808a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP50374',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 321636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Saving data for RP50374: {'auction_closing_time': 1774716295.0, 'created_time': 1773685901.74374, 'last_price_update_time': 1774696355.198819}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP50374') HTTP/1.1" 204 0
2026-03-28 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-28 11:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-28 11:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854 to the API
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:49Z',
 'fuel_type': 'diesel',
 'id': '19d8c31a-db4b-5a8a-86a3-e22584b70f1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91854',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 298768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-11',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Saving data for LC91854: {'auction_closing_time': 1774716829.0, 'created_time': 1774608182.975268, 'last_price_update_time': 1774696355.631195}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91854') HTTP/1.1" 204 0
2026-03-28 11:12:35 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Scrape type for XD11713: 2
2026-03-28 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-28 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71a0007e-82fc-524f-8c93-a1303c8d44ec, identifier: XD11713
2026-03-28 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:35 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Scrape type for ZF67159: 2
2026-03-28 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-28 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b2a7a36-a626-5768-a530-7b5257554d7a, identifier: ZF67159
2026-03-28 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-28 11:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-28 11:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713 to the API
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:45:02Z',
 'fuel_type': 'diesel',
 'id': '71a0007e-82fc-524f-8c93-a1303c8d44ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD11713',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 264567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2025}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Saving data for XD11713: {'auction_closing_time': 1774716302.0, 'created_time': 1773302971.43695, 'last_price_update_time': 1774696356.150244}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD11713') HTTP/1.1" 204 0
2026-03-28 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-28 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-28 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159 to the API
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:32:56Z',
 'fuel_type': 'petrol',
 'id': '2b2a7a36-a626-5768-a530-7b5257554d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF67159',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 75424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': None,
 'title': 'MINI Clubman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2021}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Saving data for ZF67159: {'auction_closing_time': 1774715576.0, 'created_time': 1773400589.124209, 'last_price_update_time': 1774696356.461267}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF67159') HTTP/1.1" 204 0
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Scrape type for WD55568: 2
2026-03-28 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-28 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0076f557-b5b5-58ef-b072-0ac72c7d2562, identifier: WD55568
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-28 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-28 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-28 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568 to the API
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:15:57Z',
 'fuel_type': 'diesel',
 'id': '0076f557-b5b5-58ef-b072-0ac72c7d2562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD55568',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 97955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-10',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Saving data for WD55568: {'auction_closing_time': 1774714557.0, 'created_time': 1773773456.523802, 'last_price_update_time': 1774696356.906362}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD55568') HTTP/1.1" 204 0
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Scrape type for NV33173: 2
2026-03-28 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-28 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c465186e-8268-561e-ad6b-eb0a2371b7e4, identifier: NV33173
2026-03-28 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-28 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-28 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173 to the API
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'petrol',
 'id': 'c465186e-8268-561e-ad6b-eb0a2371b7e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV33173',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 106029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Saving data for NV33173: {'auction_closing_time': 1774715126.0, 'created_time': 1773858921.751075, 'last_price_update_time': 1774696357.329654}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV33173') HTTP/1.1" 204 0
2026-03-28 11:12:37 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 9710 | hits on page: 40
2026-03-28 11:12:37 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Scrape type for YT60499: 2
2026-03-28 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-28 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 314e6253-8b60-580d-b2a3-cb05e09fffff, identifier: YT60499
2026-03-28 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-28 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-28 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499 to the API
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:06:14Z',
 'fuel_type': 'petrol',
 'id': '314e6253-8b60-580d-b2a3-cb05e09fffff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT60499',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 86340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Ranger Comfort',
 'transmission': 'manual',
 'trim': 'Ranger Comfort',
 'year': 2015}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Saving data for YT60499: {'auction_closing_time': 1774713974.0, 'created_time': 1773858693.232277, 'last_price_update_time': 1774696357.758179}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT60499') HTTP/1.1" 204 0
2026-03-28 11:12:37 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Scrape type for JS31219: 2
2026-03-28 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-28 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae55bdd6-1a7d-5d33-8f2a-b46dba209687, identifier: JS31219
2026-03-28 11:12:37 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Scrape type for HS55483: 2
2026-03-28 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-28 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e2b035-b70f-558c-9af8-265d21cb9619, identifier: HS55483
2026-03-28 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-28 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-28 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219 to the API
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:40:53Z',
 'fuel_type': 'diesel',
 'id': 'ae55bdd6-1a7d-5d33-8f2a-b46dba209687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS31219',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 93015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.7 CDTI 150 Jahre Opel',
 'transmission': 'automatic',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Saving data for JS31219: {'auction_closing_time': 1774716053.0, 'created_time': 1773429031.571345, 'last_price_update_time': 1774696358.366156}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS31219') HTTP/1.1" 204 0
2026-03-28 11:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-28 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-28 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483 to the API
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:07Z',
 'fuel_type': 'petrol',
 'id': '27e2b035-b70f-558c-9af8-265d21cb9619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55483',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 68336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop 4x4',
 'transmission': 'manual',
 'trim': 'Active Start/Stop 4x4',
 'year': 2017}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Saving data for HS55483: {'auction_closing_time': 1774716487.0, 'created_time': 1773137666.962019, 'last_price_update_time': 1774696358.67934}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55483') HTTP/1.1" 204 0
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Scrape type for CC89680: 2
2026-03-28 11:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-28 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e630a218-7e39-5e7d-9622-3e994f3d8c27, identifier: CC89680
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Scrape type for XE26333: 2
2026-03-28 11:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-28 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d759cfc9-b2e2-50e0-84ab-45e2145608f2, identifier: XE26333
2026-03-28 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-28 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680 to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:38Z',
 'fuel_type': 'diesel',
 'id': 'e630a218-7e39-5e7d-9622-3e994f3d8c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2012}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Saving data for CC89680: {'auction_closing_time': 1774714898.0, 'created_time': 1773775349.992967, 'last_price_update_time': 1774696359.260879}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89680') HTTP/1.1" 204 0
2026-03-28 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-28 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333 to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:57Z',
 'fuel_type': 'diesel',
 'id': 'd759cfc9-b2e2-50e0-84ab-45e2145608f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE26333',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 187267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-26',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Saving data for XE26333: {'auction_closing_time': 1774716117.0, 'created_time': 1773772239.073326, 'last_price_update_time': 1774696359.710399}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE26333') HTTP/1.1" 204 0
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Scrape type for BR76788: 2
2026-03-28 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-28 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f645e6db-676f-559d-8c38-0bac708f8059, identifier: BR76788
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Scrape type for FZ40219: 2
2026-03-28 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-28 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d, identifier: FZ40219
2026-03-28 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-28 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-28 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788 to the API
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:19:51Z',
 'fuel_type': 'petrol',
 'id': 'f645e6db-676f-559d-8c38-0bac708f8059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR76788',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 193704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Saving data for BR76788: {'auction_closing_time': 1774714791.0, 'created_time': 1773304689.771843, 'last_price_update_time': 1774696360.289521}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR76788') HTTP/1.1" 204 0
2026-03-28 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-28 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-28 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219 to the API
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:03:22Z',
 'fuel_type': 'petrol',
 'id': '46584ce2-db7a-5b7a-95ef-b2c69c5df76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ40219',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 63120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'MINI One Metropolitan',
 'transmission': 'manual',
 'trim': 'Metropolitan',
 'year': 2015}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Saving data for FZ40219: {'auction_closing_time': 1774713802.0, 'created_time': 1773860421.919325, 'last_price_update_time': 1774696360.594257}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ40219') HTTP/1.1" 204 0
2026-03-28 11:12:40 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Scrape type for CG27437: 2
2026-03-28 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-28 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f75f6a61-3768-5130-89b4-e9aea0cb319b, identifier: CG27437
2026-03-28 11:12:40 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 11:12:40 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Scrape type for GM47642: 2
2026-03-28 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-28 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a330c4-12b1-520f-b19a-9eb7713f2eb0, identifier: GM47642
2026-03-28 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-28 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-28 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437 to the API
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:50Z',
 'fuel_type': 'petrol',
 'id': 'f75f6a61-3768-5130-89b4-e9aea0cb319b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG27437',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C8',
 'odometer': 235391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-23',
 'seller_name': None,
 'title': 'Citroen C8 2.0 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2006}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Saving data for CG27437: {'auction_closing_time': 1774715930.0, 'created_time': 1774118381.392202, 'last_price_update_time': 1774696361.277637}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG27437') HTTP/1.1" 204 0
2026-03-28 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-28 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-28 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642 to the API
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:48Z',
 'fuel_type': 'petrol',
 'id': '34a330c4-12b1-520f-b19a-9eb7713f2eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM47642',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 76651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-07',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2019}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Saving data for GM47642: {'auction_closing_time': 1774715388.0, 'created_time': 1773859992.552013, 'last_price_update_time': 1774696361.586866}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM47642') HTTP/1.1" 204 0
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Scrape type for BK33721: 2
2026-03-28 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-28 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 412071c1-bba9-5b08-a0d7-17f78cac9a27, identifier: BK33721
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Scrape type for FM56481: 2
2026-03-28 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-28 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67e91dfa-05b5-5d14-bad5-256387ac454b, identifier: FM56481
2026-03-28 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-28 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-28 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721 to the API
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:54Z',
 'fuel_type': 'diesel',
 'id': '412071c1-bba9-5b08-a0d7-17f78cac9a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK33721',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 211079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Saving data for BK33721: {'auction_closing_time': 1774715994.0, 'created_time': 1773302587.986018, 'last_price_update_time': 1774696362.122747}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK33721') HTTP/1.1" 204 0
2026-03-28 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-28 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-28 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481 to the API
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:35Z',
 'fuel_type': 'diesel',
 'id': '67e91dfa-05b5-5d14-bad5-256387ac454b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM56481',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 224861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Saving data for FM56481: {'auction_closing_time': 1774716035.0, 'created_time': 1774290713.601124, 'last_price_update_time': 1774696362.439204}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM56481') HTTP/1.1" 204 0
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Scrape type for NT60185: 2
2026-03-28 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-28 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abe15317-01ff-5dd8-a58a-abeea1216824, identifier: NT60185
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Scrape type for GG14507: 2
2026-03-28 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-28 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5380c6c-6f5f-547b-951a-a508a6b76001, identifier: GG14507
2026-03-28 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-28 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-28 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185 to the API
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'petrol',
 'id': 'abe15317-01ff-5dd8-a58a-abeea1216824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT60185',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 73291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Saving data for NT60185: {'auction_closing_time': 1774715403.0, 'created_time': 1773466618.589498, 'last_price_update_time': 1774696363.036117}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT60185') HTTP/1.1" 204 0
2026-03-28 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-28 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-28 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507 to the API
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:56:34Z',
 'fuel_type': 'diesel',
 'id': 'e5380c6c-6f5f-547b-951a-a508a6b76001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG14507',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 300747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI T 4Matic BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Saving data for GG14507: {'auction_closing_time': 1774716994.0, 'created_time': 1774293749.214221, 'last_price_update_time': 1774696363.442797}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG14507') HTTP/1.1" 204 0
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Scrape type for NY07773: 2
2026-03-28 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-28 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831275b-282c-5125-8313-4e3b3d532bee, identifier: NY07773
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Scrape type for RV05301: 2
2026-03-28 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-28 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4, identifier: RV05301
2026-03-28 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-28 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-28 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773 to the API
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:05Z',
 'fuel_type': 'diesel',
 'id': 'd831275b-282c-5125-8313-4e3b3d532bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY07773',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 77993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Saving data for NY07773: {'auction_closing_time': 1774716005.0, 'created_time': 1773775491.261199, 'last_price_update_time': 1774696363.986932}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY07773') HTTP/1.1" 204 0
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-28 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301 to the API
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:11:30Z',
 'fuel_type': 'diesel',
 'id': '431ce18c-82c4-57bf-b8f5-21e7299e3ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV05301',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 180724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Saving data for RV05301: {'auction_closing_time': 1774714290.0, 'created_time': 1773830149.684609, 'last_price_update_time': 1774696364.324788}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV05301') HTTP/1.1" 204 0
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Scrape type for EB92999: 2
2026-03-28 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-28 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95713ae8-6435-5868-b6af-fd757137e7ab, identifier: EB92999
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Scrape type for MY83778: 2
2026-03-28 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-28 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa095269-b25b-5e90-9959-ff24b43c0221 with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa095269-b25b-5e90-9959-ff24b43c0221 with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa095269-b25b-5e90-9959-ff24b43c0221, identifier: MY83778
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-28 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999 to the API
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:19:26Z',
 'fuel_type': 'petrol',
 'id': '95713ae8-6435-5868-b6af-fd757137e7ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB92999',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C70',
 'odometer': 165515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-27',
 'seller_name': None,
 'title': 'Volvo C70 2.4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2007}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Saving data for EB92999: {'auction_closing_time': 1774714766.0, 'created_time': 1773226219.991848, 'last_price_update_time': 1774696364.872436}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB92999') HTTP/1.1" 204 0
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-28 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778 to the API
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': 'fa095269-b25b-5e90-9959-ff24b43c0221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY83778',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 88776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-22',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Saving data for MY83778: {'auction_closing_time': 1774716349.0, 'created_time': 1773305683.087738, 'last_price_update_time': 1774696365.18894}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY83778') HTTP/1.1" 204 0
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Scrape type for XJ26035: 2
2026-03-28 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-28 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db92ae2d-2098-5620-ae30-97002b745125, identifier: XJ26035
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Scrape type for TL69510: 2
2026-03-28 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-28 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f972975e-5b75-5849-b630-26553e6dd0d5, identifier: TL69510
2026-03-28 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-28 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-28 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035 to the API
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 441,
 'expiration_date': '2026-03-28T16:34:23Z',
 'fuel_type': 'petrol',
 'id': 'db92ae2d-2098-5620-ae30-97002b745125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ26035',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 109422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Porsche Macan Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Saving data for XJ26035: {'auction_closing_time': 1774715663.0, 'created_time': 1774033108.242731, 'last_price_update_time': 1774696365.766195}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ26035') HTTP/1.1" 204 0
2026-03-28 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-28 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-28 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510 to the API
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:05Z',
 'fuel_type': 'diesel',
 'id': 'f972975e-5b75-5849-b630-26553e6dd0d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL69510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 70004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
 'transmission': 'manual',
 'trim': '340 L1 Trail',
 'year': 2022}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Saving data for TL69510: {'auction_closing_time': 1774714205.0, 'created_time': 1773426861.937701, 'last_price_update_time': 1774696366.39576}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL69510') HTTP/1.1" 204 0
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Scrape type for KL53261: 2
2026-03-28 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-28 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75b34864-2364-59c2-a9c5-b94e2c1576f7 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75b34864-2364-59c2-a9c5-b94e2c1576f7 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75b34864-2364-59c2-a9c5-b94e2c1576f7, identifier: KL53261
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Scrape type for WW79477: 2
2026-03-28 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-28 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3, identifier: WW79477
2026-03-28 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-28 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-28 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261 to the API
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:19:23Z',
 'fuel_type': 'petrol',
 'id': '75b34864-2364-59c2-a9c5-b94e2c1576f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53261',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 53881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-08',
 'seller_name': None,
 'title': 'Volvo S60 2.0 B5 Mild-Hybrid Ultimate Dark AWD',
 'transmission': 'automatic',
 'trim': 'Ultimate Dark AWD',
 'year': 2024}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Saving data for KL53261: {'auction_closing_time': 1774714763.0, 'created_time': 1774608202.326095, 'last_price_update_time': 1774696367.007661}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL53261') HTTP/1.1" 204 0
2026-03-28 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-28 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-28 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477 to the API
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:11:27Z',
 'fuel_type': 'petrol',
 'id': '5d024d65-1a7e-57a9-a3bb-65b68b2474e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW79477',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 148452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Seat Altea 1.2 TSI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2011}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Saving data for WW79477: {'auction_closing_time': 1774714287.0, 'created_time': 1774262252.696002, 'last_price_update_time': 1774696367.312284}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW79477') HTTP/1.1" 204 0
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Scrape type for EU72034: 2
2026-03-28 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-28 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26, identifier: EU72034
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Scrape type for YA95886: 2
2026-03-28 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-28 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5, identifier: YA95886
2026-03-28 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-28 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-28 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034 to the API
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:17:09Z',
 'fuel_type': 'diesel',
 'id': 'c4d6d7bb-71d0-543e-8dc1-f6debd3fab26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU72034',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 124574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': None,
 'title': 'BMW 3er 330d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Saving data for EU72034: {'auction_closing_time': 1774714629.0, 'created_time': 1773307033.754092, 'last_price_update_time': 1774696368.03948}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU72034') HTTP/1.1" 204 0
2026-03-28 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-28 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-28 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886 to the API
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'petrol',
 'id': 'c4d7653f-d6ac-501d-a1c2-cbb49ea863a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA95886',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 64764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-16',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Saving data for YA95886: {'auction_closing_time': 1774715213.0, 'created_time': 1773687306.071139, 'last_price_update_time': 1774696368.370794}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA95886') HTTP/1.1" 204 0
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Scrape type for UX71045: 2
2026-03-28 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-28 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2edc74-54cf-5d4f-b79e-0971b0d785cf, identifier: UX71045
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Scrape type for VS86742: 2
2026-03-28 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-28 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82006470-a810-59fb-b933-94aeeee466a8, identifier: VS86742
2026-03-28 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-28 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-28 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045 to the API
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:18:00Z',
 'fuel_type': 'petrol',
 'id': 'da2edc74-54cf-5d4f-b79e-0971b0d785cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX71045',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 146465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Saving data for UX71045: {'auction_closing_time': 1774714680.0, 'created_time': 1773306358.837761, 'last_price_update_time': 1774696368.884084}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX71045') HTTP/1.1" 204 0
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-28 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742 to the API
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:00:54Z',
 'fuel_type': 'petrol',
 'id': '82006470-a810-59fb-b933-94aeeee466a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS86742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 161028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Saving data for VS86742: {'auction_closing_time': 1774713654.0, 'created_time': 1774294700.782556, 'last_price_update_time': 1774696369.317938}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS86742') HTTP/1.1" 204 0
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Scrape type for NC35007: 2
2026-03-28 11:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-28 11:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d37f7090-8fc8-5390-9fb5-6098960ed969, identifier: NC35007
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Scrape type for BN16879: 2
2026-03-28 11:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-28 11:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e84b357c-5975-53f1-9428-e9c9406e7413, identifier: BN16879
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-28 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007 to the API
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:37:43Z',
 'fuel_type': 'petrol',
 'id': 'd37f7090-8fc8-5390-9fb5-6098960ed969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC35007',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 74073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Seat Altea 1.4 TSI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2013}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Saving data for NC35007: {'auction_closing_time': 1774715863.0, 'created_time': 1773466753.331596, 'last_price_update_time': 1774696369.862567}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC35007') HTTP/1.1" 204 0
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-28 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879 to the API
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:38:10Z',
 'fuel_type': 'diesel',
 'id': 'e84b357c-5975-53f1-9428-e9c9406e7413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN16879',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 189540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Saving data for BN16879: {'auction_closing_time': 1774715890.0, 'created_time': 1774292828.516682, 'last_price_update_time': 1774696370.200761}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN16879') HTTP/1.1" 204 0
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Scrape type for FB31140: 2
2026-03-28 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-28 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647943a7-4e95-5bb2-8f5c-9489c90a4963, identifier: FB31140
2026-03-28 11:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-28 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-28 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140 to the API
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:48:58Z',
 'fuel_type': 'petrol',
 'id': '647943a7-4e95-5bb2-8f5c-9489c90a4963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB31140',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 266965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Saving data for FB31140: {'auction_closing_time': 1774716538.0, 'created_time': 1773860710.128866, 'last_price_update_time': 1774696370.637067}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB31140') HTTP/1.1" 204 0
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Scrape type for BA73417: 2
2026-03-28 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-28 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1e964c-8882-515d-b2cd-eb22d01542e7, identifier: BA73417
2026-03-28 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-28 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-28 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417 to the API
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:00Z',
 'fuel_type': 'diesel',
 'id': '9d1e964c-8882-515d-b2cd-eb22d01542e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA73417',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 161202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-08',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 E',
 'transmission': 'manual',
 'trim': 'E',
 'year': 2012}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Saving data for BA73417: {'auction_closing_time': 1774714920.0, 'created_time': 1774294210.947705, 'last_price_update_time': 1774696371.110889}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA73417') HTTP/1.1" 204 0
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Scrape type for DF02739: 2
2026-03-28 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-28 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03e7aab2-1b46-5b00-be64-a7c586119507, identifier: DF02739
2026-03-28 11:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-28 11:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-28 11:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739 to the API
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:47:55Z',
 'fuel_type': 'petrol',
 'id': '03e7aab2-1b46-5b00-be64-a7c586119507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF02739',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 123565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-23',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Saving data for DF02739: {'auction_closing_time': 1774716475.0, 'created_time': 1774608236.569037, 'last_price_update_time': 1774696371.543233}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF02739') HTTP/1.1" 204 0
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Scrape type for JF95451: 2
2026-03-28 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-28 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e48a98-fb1d-5000-be9e-d2b634b38df0, identifier: JF95451
2026-03-28 11:12:51 [auto1.de] INFO: Channel: 24h | Page: 234 | totalHits: 9711 | hits on page: 40
2026-03-28 11:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-28 11:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-28 11:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451 to the API
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:06:47Z',
 'fuel_type': 'petrol',
 'id': '33e48a98-fb1d-5000-be9e-d2b634b38df0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF95451',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 135234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2012}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Saving data for JF95451: {'auction_closing_time': 1774714007.0, 'created_time': 1773661903.507089, 'last_price_update_time': 1774696372.105447}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF95451') HTTP/1.1" 204 0
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Scrape type for ZT19745: 2
2026-03-28 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-28 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23c1c00f-e897-5d4d-a512-23f164f7b79c, identifier: ZT19745
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Scrape type for TE39343: 2
2026-03-28 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-28 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a615796-5005-5ed1-9c2a-e3cee4072121, identifier: TE39343
2026-03-28 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-28 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-28 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745 to the API
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:44Z',
 'fuel_type': 'diesel',
 'id': '23c1c00f-e897-5d4d-a512-23f164f7b79c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT19745',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 241747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Saving data for ZT19745: {'auction_closing_time': 1774716044.0, 'created_time': 1772729586.532447, 'last_price_update_time': 1774696372.66059}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT19745') HTTP/1.1" 204 0
2026-03-28 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-28 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-28 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343 to the API
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'petrol',
 'id': '3a615796-5005-5ed1-9c2a-e3cee4072121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE39343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 130813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-27',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Saving data for TE39343: {'auction_closing_time': 1774715322.0, 'created_time': 1773343749.517569, 'last_price_update_time': 1774696372.981931}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE39343') HTTP/1.1" 204 0
2026-03-28 11:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Scrape type for YE46941: 2
2026-03-28 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-28 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d63ba39-de09-516d-95e4-e3885ba51ce3, identifier: YE46941
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Scrape type for KH46132: 2
2026-03-28 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-28 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aecf218-ebd9-5529-aea2-fe91ca5d706f, identifier: KH46132
2026-03-28 11:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-28 11:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-28 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941 to the API
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:44:47Z',
 'fuel_type': 'diesel',
 'id': '6d63ba39-de09-516d-95e4-e3885ba51ce3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE46941',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 129869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Saving data for YE46941: {'auction_closing_time': 1774716287.0, 'created_time': 1773304500.754375, 'last_price_update_time': 1774696373.551457}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE46941') HTTP/1.1" 204 0
2026-03-28 11:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-28 11:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-28 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132 to the API
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:51:12Z',
 'fuel_type': 'petrol',
 'id': '9aecf218-ebd9-5529-aea2-fe91ca5d706f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH46132',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 161139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Audi A5 Sportback 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Saving data for KH46132: {'auction_closing_time': 1774716672.0, 'created_time': 1773662246.605323, 'last_price_update_time': 1774696373.917127}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH46132') HTTP/1.1" 204 0
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Scrape type for US92808: 2
2026-03-28 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-28 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043cb944-7be5-5ff5-b28d-fe814ebeef02, identifier: US92808
2026-03-28 11:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-28 11:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-28 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808 to the API
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:32Z',
 'fuel_type': 'petrol',
 'id': '043cb944-7be5-5ff5-b28d-fe814ebeef02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US92808',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 137176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Saving data for US92808: {'auction_closing_time': 1774714232.0, 'created_time': 1774264926.92802, 'last_price_update_time': 1774696374.400314}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US92808') HTTP/1.1" 204 0
2026-03-28 11:12:54 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Scrape type for AB79504: 2
2026-03-28 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-28 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72cc7b6-e2a6-536a-9133-863a3c2098c4 with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b72cc7b6-e2a6-536a-9133-863a3c2098c4 with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b72cc7b6-e2a6-536a-9133-863a3c2098c4, identifier: AB79504
2026-03-28 11:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-28 11:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-28 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504 to the API
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:01:30Z',
 'fuel_type': 'petrol',
 'id': 'b72cc7b6-e2a6-536a-9133-863a3c2098c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB79504',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 118697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Saving data for AB79504: {'auction_closing_time': 1774713690.0, 'created_time': 1774608353.351295, 'last_price_update_time': 1774696374.945317}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB79504') HTTP/1.1" 204 0
2026-03-28 11:12:54 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Scrape type for ZM88975: 2
2026-03-28 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-28 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72, identifier: ZM88975
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-28 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975 to the API
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:53:45Z',
 'fuel_type': 'petrol',
 'id': '8e4010db-f408-54ff-8bb7-bd1b5ed02f72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM88975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 147322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Saving data for ZM88975: {'auction_closing_time': 1774716825.0, 'created_time': 1773306829.193955, 'last_price_update_time': 1774696375.378592}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM88975') HTTP/1.1" 204 0
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Scrape type for TJ16115: 2
2026-03-28 11:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-28 11:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9, identifier: TJ16115
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-28 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115 to the API
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:34:39Z',
 'fuel_type': 'petrol',
 'id': '47cd58ea-691f-574d-a63d-e5c94ebbc9a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ16115',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Journey',
 'odometer': 118837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-21',
 'seller_name': None,
 'title': 'Dodge Journey 2.4 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2008}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Saving data for TJ16115: {'auction_closing_time': 1774715679.0, 'created_time': 1774290667.910521, 'last_price_update_time': 1774696375.829621}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ16115') HTTP/1.1" 204 0
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Scrape type for RS52276: 2
2026-03-28 11:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-28 11:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7, identifier: RS52276
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-28 11:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276 to the API
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:21Z',
 'fuel_type': 'diesel',
 'id': '5a1ef24b-0de9-5da0-97e9-5b85172f74c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52276',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 138688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Saving data for RS52276: {'auction_closing_time': 1774714221.0, 'created_time': 1773686860.273271, 'last_price_update_time': 1774696376.255728}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52276') HTTP/1.1" 204 0
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Scrape type for GN84809: 2
2026-03-28 11:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-28 11:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1413d98a-f689-5bad-8148-522bccaf80b0, identifier: GN84809
2026-03-28 11:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-28 11:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-28 11:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809 to the API
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': '1413d98a-f689-5bad-8148-522bccaf80b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN84809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 46280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Saving data for GN84809: {'auction_closing_time': 1774714544.0, 'created_time': 1774292734.001056, 'last_price_update_time': 1774696376.668612}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN84809') HTTP/1.1" 204 0
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Scrape type for DX61886: 2
2026-03-28 11:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-28 11:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1669ee62-6172-5c20-bf51-2dd54c7f34c9, identifier: DX61886
2026-03-28 11:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-28 11:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-28 11:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886 to the API
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:01:41Z',
 'fuel_type': 'diesel',
 'id': '1669ee62-6172-5c20-bf51-2dd54c7f34c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX61886',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 288118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Saving data for DX61886: {'auction_closing_time': 1774713701.0, 'created_time': 1773304013.021955, 'last_price_update_time': 1774696377.086889}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX61886') HTTP/1.1" 204 0
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Scrape type for AK65785: 2
2026-03-28 11:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-28 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8, identifier: AK65785
2026-03-28 11:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-28 11:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-28 11:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785 to the API
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:25Z',
 'fuel_type': 'diesel',
 'id': 'fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK65785',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 254611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-08',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2010}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Saving data for AK65785: {'auction_closing_time': 1774716145.0, 'created_time': 1773340412.094104, 'last_price_update_time': 1774696377.52937}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK65785') HTTP/1.1" 204 0
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Scrape type for AK97582: 2
2026-03-28 11:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-28 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a96c028-88df-5a2b-ad32-08e90bfc63a7, identifier: AK97582
2026-03-28 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-28 11:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-28 11:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582 to the API
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:36:00Z',
 'fuel_type': 'diesel',
 'id': '3a96c028-88df-5a2b-ad32-08e90bfc63a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK97582',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 171299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTD BlueMotion Tech',
 'year': 2016}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Saving data for AK97582: {'auction_closing_time': 1774715760.0, 'created_time': 1773400040.589577, 'last_price_update_time': 1774696377.957482}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK97582') HTTP/1.1" 204 0
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Scrape type for GE73392: 2
2026-03-28 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-28 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2211956b-d640-524c-aa47-e3c27fd05087, identifier: GE73392
2026-03-28 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-28 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-28 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392 to the API
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:53Z',
 'fuel_type': 'petrol',
 'id': '2211956b-d640-524c-aa47-e3c27fd05087',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE73392',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 169383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Saving data for GE73392: {'auction_closing_time': 1774713773.0, 'created_time': 1773401026.680172, 'last_price_update_time': 1774696378.566289}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE73392') HTTP/1.1" 204 0
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Scrape type for WJ93096: 2
2026-03-28 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-28 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ffe804-94e7-5d1d-a171-617d00f837cf with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54ffe804-94e7-5d1d-a171-617d00f837cf with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54ffe804-94e7-5d1d-a171-617d00f837cf, identifier: WJ93096
2026-03-28 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-28 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-28 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096 to the API
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'hybrid',
 'id': '54ffe804-94e7-5d1d-a171-617d00f837cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93096',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 22119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-27',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x2',
 'transmission': 'automatic',
 'trim': 'Comfort 4x2',
 'year': 2023}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Saving data for WJ93096: {'auction_closing_time': 1774715577.0, 'created_time': 1774608233.898749, 'last_price_update_time': 1774696379.135086}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ93096') HTTP/1.1" 204 0
2026-03-28 11:12:59 [auto1.de] INFO: Channel: 24h | Page: 235 | totalHits: 9712 | hits on page: 40
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Scrape type for PE74408: 2
2026-03-28 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-28 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 159e9741-1e31-5964-8229-43882a37d005, identifier: PE74408
2026-03-28 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-28 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-28 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408 to the API
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:02:12Z',
 'fuel_type': 'petrol',
 'id': '159e9741-1e31-5964-8229-43882a37d005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE74408',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 112645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2011}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Saving data for PE74408: {'auction_closing_time': 1774713732.0, 'created_time': 1773686803.45991, 'last_price_update_time': 1774696379.601951}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE74408') HTTP/1.1" 204 0
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Scrape type for ZZ79893: 2
2026-03-28 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-28 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d511f27d-b882-54db-8c50-d5592c08d4bb with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d511f27d-b882-54db-8c50-d5592c08d4bb with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d511f27d-b882-54db-8c50-d5592c08d4bb, identifier: ZZ79893
2026-03-28 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Scrape type for UY58997: 2
2026-03-28 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-28 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54791adc-5d23-549f-bd47-19b2bc5830b8, identifier: UY58997
2026-03-28 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-28 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-28 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893 to the API
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:23Z',
 'fuel_type': 'diesel',
 'id': 'd511f27d-b882-54db-8c50-d5592c08d4bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ79893',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 313169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 211 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Saving data for ZZ79893: {'auction_closing_time': 1774716143.0, 'created_time': 1774608208.2517, 'last_price_update_time': 1774696380.205351}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ79893') HTTP/1.1" 204 0
2026-03-28 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-28 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-28 11:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997 to the API
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '54791adc-5d23-549f-bd47-19b2bc5830b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY58997',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 211633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-23',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2015}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Saving data for UY58997: {'auction_closing_time': 1774715037.0, 'created_time': 1773400151.835633, 'last_price_update_time': 1774696380.526566}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY58997') HTTP/1.1" 204 0
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Scrape type for HK54486: 2
2026-03-28 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-28 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74871e20-678b-5caa-b1e5-ee87c8224f36 with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74871e20-678b-5caa-b1e5-ee87c8224f36 with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74871e20-678b-5caa-b1e5-ee87c8224f36, identifier: HK54486
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Scrape type for GG04913: 2
2026-03-28 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-28 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f641387c-fa4d-5f22-9253-6b27d0e51fff with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f641387c-fa4d-5f22-9253-6b27d0e51fff with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f641387c-fa4d-5f22-9253-6b27d0e51fff, identifier: GG04913
2026-03-28 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-28 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-28 11:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486 to the API
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:28:23Z',
 'fuel_type': 'diesel',
 'id': '74871e20-678b-5caa-b1e5-ee87c8224f36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK54486',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 65045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2020}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Saving data for HK54486: {'auction_closing_time': 1774715303.0, 'created_time': 1774608219.004252, 'last_price_update_time': 1774696381.100417}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK54486') HTTP/1.1" 204 0
2026-03-28 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-28 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-28 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913 to the API
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:21Z',
 'fuel_type': 'petrol',
 'id': 'f641387c-fa4d-5f22-9253-6b27d0e51fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG04913',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 153142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-18',
 'seller_name': None,
 'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Saving data for GG04913: {'auction_closing_time': 1774717041.0, 'created_time': 1774608227.912072, 'last_price_update_time': 1774696381.44151}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG04913') HTTP/1.1" 204 0
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Scrape type for CU93791: 2
2026-03-28 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-28 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88a0781d-9fb6-5681-a8d9-72f4f6bad567, identifier: CU93791
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Scrape type for ZS47676: 2
2026-03-28 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-28 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed011539-6c54-56ca-a50a-4ce55ee95ad3, identifier: ZS47676
2026-03-28 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-28 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-28 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791 to the API
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:04:41Z',
 'fuel_type': 'diesel',
 'id': '88a0781d-9fb6-5681-a8d9-72f4f6bad567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU93791',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 191121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 115 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2010}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Saving data for CU93791: {'auction_closing_time': 1774713881.0, 'created_time': 1773135415.80223, 'last_price_update_time': 1774696382.130265}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU93791') HTTP/1.1" 204 0
2026-03-28 11:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-28 11:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-28 11:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676 to the API
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:42:57Z',
 'fuel_type': 'diesel',
 'id': 'ed011539-6c54-56ca-a50a-4ce55ee95ad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS47676',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 297353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Volvo S80 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Saving data for ZS47676: {'auction_closing_time': 1774716177.0, 'created_time': 1773659610.705324, 'last_price_update_time': 1774696382.540859}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS47676') HTTP/1.1" 204 0
2026-03-28 11:13:02 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 11:13:02 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Scrape type for XD58993: 2
2026-03-28 11:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-28 11:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab34de3c-8ce6-5bd7-a9cf-2943e620d101, identifier: XD58993
2026-03-28 11:13:02 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Scrape type for JL44277: 2
2026-03-28 11:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-28 11:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f22e8c-2112-5084-a9a8-ad17ff597449, identifier: JL44277
2026-03-28 11:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-28 11:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-28 11:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993 to the API
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:32:49Z',
 'fuel_type': 'petrol',
 'id': 'ab34de3c-8ce6-5bd7-a9cf-2943e620d101',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD58993',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 79439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-19',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Saving data for XD58993: {'auction_closing_time': 1774715569.0, 'created_time': 1774292078.54508, 'last_price_update_time': 1774696383.10495}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD58993') HTTP/1.1" 204 0
2026-03-28 11:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-28 11:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-28 11:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277 to the API
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'petrol',
 'id': '19f22e8c-2112-5084-a9a8-ad17ff597449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL44277',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 102170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Saving data for JL44277: {'auction_closing_time': 1774717151.0, 'created_time': 1773400272.865453, 'last_price_update_time': 1774696383.43387}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL44277') HTTP/1.1" 204 0
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Scrape type for PA88457: 2
2026-03-28 11:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-28 11:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a24cda0c-a7b8-5c54-87f4-2082439417f9, identifier: PA88457
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Scrape type for KB62018: 2
2026-03-28 11:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-28 11:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8946c4-b99a-539b-844f-81a6e922f860, identifier: KB62018
2026-03-28 11:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-28 11:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-28 11:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457 to the API
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:35:30Z',
 'fuel_type': 'petrol',
 'id': 'a24cda0c-a7b8-5c54-87f4-2082439417f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA88457',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 99627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2014}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Saving data for PA88457: {'auction_closing_time': 1774715730.0, 'created_time': 1773427388.413136, 'last_price_update_time': 1774696383.995092}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA88457') HTTP/1.1" 204 0
2026-03-28 11:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-28 11:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-28 11:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018 to the API
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:05:16Z',
 'fuel_type': 'petrol',
 'id': '3a8946c4-b99a-539b-844f-81a6e922f860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62018',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 87971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2016}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Saving data for KB62018: {'auction_closing_time': 1774713916.0, 'created_time': 1773687140.572818, 'last_price_update_time': 1774696384.372459}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62018') HTTP/1.1" 204 0
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Scrape type for EN47046: 2
2026-03-28 11:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-28 11:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8, identifier: EN47046
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Scrape type for EG39650: 2
2026-03-28 11:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-28 11:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7, identifier: EG39650
2026-03-28 11:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-28 11:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-28 11:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046 to the API
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:23:37Z',
 'fuel_type': 'petrol',
 'id': 'bb8a476f-fbfb-5fb0-aad4-d11096cca2f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN47046',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 50733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Saving data for EN47046: {'auction_closing_time': 1774715017.0, 'created_time': 1773304504.903672, 'last_price_update_time': 1774696384.944137}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN47046') HTTP/1.1" 204 0
2026-03-28 11:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-28 11:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-28 11:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650 to the API
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:51:11Z',
 'fuel_type': 'petrol',
 'id': 'eeafaff6-53e5-5f11-8bfc-7fca17bbadd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 23305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Saving data for EG39650: {'auction_closing_time': 1774716671.0, 'created_time': 1773427446.950694, 'last_price_update_time': 1774696385.365388}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39650') HTTP/1.1" 204 0
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Scrape type for FA01437: 2
2026-03-28 11:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-28 11:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7faba9-cc21-5799-99dc-585bf8cf5059, identifier: FA01437
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Scrape type for ZV64166: 2
2026-03-28 11:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-28 11:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099, identifier: ZV64166
2026-03-28 11:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-28 11:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-28 11:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437 to the API
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:43Z',
 'fuel_type': 'diesel',
 'id': 'cf7faba9-cc21-5799-99dc-585bf8cf5059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA01437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Saving data for FA01437: {'auction_closing_time': 1774717003.0, 'created_time': 1773468869.642692, 'last_price_update_time': 1774696385.935979}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA01437') HTTP/1.1" 204 0
2026-03-28 11:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-28 11:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-28 11:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166 to the API
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV64166',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 158433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Saving data for ZV64166: {'auction_closing_time': 1774714134.0, 'created_time': 1773859696.164347, 'last_price_update_time': 1774696386.407161}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV64166') HTTP/1.1" 204 0
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Scrape type for XL62342: 2
2026-03-28 11:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-28 11:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1918c4-2534-5147-91cd-34cec44efe9c, identifier: XL62342
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Scrape type for EC93517: 2
2026-03-28 11:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-28 11:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682696fe-9d7c-55a9-9875-9e834f054b1e, identifier: EC93517
2026-03-28 11:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-28 11:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-28 11:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342 to the API
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:48:56Z',
 'fuel_type': 'diesel',
 'id': '0f1918c4-2534-5147-91cd-34cec44efe9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL62342',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 195504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-15',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 e-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2012}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Saving data for XL62342: {'auction_closing_time': 1774716536.0, 'created_time': 1773776268.888814, 'last_price_update_time': 1774696386.972044}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL62342') HTTP/1.1" 204 0
2026-03-28 11:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-28 11:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-28 11:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517 to the API
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:42:55Z',
 'fuel_type': 'petrol',
 'id': '682696fe-9d7c-55a9-9875-9e834f054b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC93517',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 215659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-25',
 'seller_name': None,
 'title': 'BMW 3er 325i Edition Exclusiv',
 'transmission': 'automatic',
 'trim': 'Edition Exclusiv',
 'year': 2003}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Saving data for EC93517: {'auction_closing_time': 1774716175.0, 'created_time': 1773400170.806879, 'last_price_update_time': 1774696387.298823}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC93517') HTTP/1.1" 204 0
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Scrape type for WS30363: 2
2026-03-28 11:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-28 11:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d40c8af3-85dc-5213-beaf-c8ffeb1c4308, identifier: WS30363
2026-03-28 11:13:07 [scrapy.extensions.logstats] INFO: Crawled 442 pages (at 7 pages/min), scraped 1010 items (at 111 items/min)
2026-03-28 11:13:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Scrape type for HD14897: 2
2026-03-28 11:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-28 11:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c581c3-0e12-5593-a40f-1af187fc8a22, identifier: HD14897
2026-03-28 11:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-28 11:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-28 11:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363 to the API
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:17:59Z',
 'fuel_type': 'diesel',
 'id': 'd40c8af3-85dc-5213-beaf-c8ffeb1c4308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS30363',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 183701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-21',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Saving data for WS30363: {'auction_closing_time': 1774714679.0, 'created_time': 1773776182.625323, 'last_price_update_time': 1774696388.002164}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS30363') HTTP/1.1" 204 0
2026-03-28 11:13:08 [auto1.de] INFO: Channel: 24h | Page: 236 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-28 11:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-28 11:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897 to the API
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 382,
 'expiration_date': '2026-03-28T16:23:17Z',
 'fuel_type': 'diesel',
 'id': '41c581c3-0e12-5593-a40f-1af187fc8a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD14897',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 259189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-21',
 'seller_name': None,
 'title': 'Porsche Cayenne S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Saving data for HD14897: {'auction_closing_time': 1774714997.0, 'created_time': 1773860073.807691, 'last_price_update_time': 1774696388.349464}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD14897') HTTP/1.1" 204 0
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for PF96299: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbc4fbc3-f0da-5025-92a3-c519958b6b77, identifier: PF96299
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for BK94674: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 198b82d6-c514-566b-92a6-0e5d2dc209e3, identifier: BK94674
2026-03-28 11:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-28 11:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-28 11:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299 to the API
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:25:22Z',
 'fuel_type': 'diesel',
 'id': 'bbc4fbc3-f0da-5025-92a3-c519958b6b77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF96299',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 245018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-08',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2013}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Saving data for PF96299: {'auction_closing_time': 1774715122.0, 'created_time': 1773860148.160139, 'last_price_update_time': 1774696388.954642}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF96299') HTTP/1.1" 204 0
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for VW56389: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e, identifier: VW56389
2026-03-28 11:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-28 11:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-28 11:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674 to the API
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'diesel',
 'id': '198b82d6-c514-566b-92a6-0e5d2dc209e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK94674',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 154701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Saving data for BK94674: {'auction_closing_time': 1774717151.0, 'created_time': 1773307443.015212, 'last_price_update_time': 1774696389.389976}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK94674') HTTP/1.1" 204 0
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Scrape type for JV32404: 2
2026-03-28 11:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-28 11:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d2535b8-9fd6-519a-a0c4-0e668ad58837, identifier: JV32404
2026-03-28 11:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-28 11:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-28 11:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389 to the API
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:33:22Z',
 'fuel_type': 'petrol',
 'id': '9df2b1f6-ab6c-52b5-a538-bfdb67ae759e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW56389',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 62023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Saving data for VW56389: {'auction_closing_time': 1774715602.0, 'created_time': 1773860021.136409, 'last_price_update_time': 1774696389.867672}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW56389') HTTP/1.1" 204 0
2026-03-28 11:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for WP47747: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16, identifier: WP47747
2026-03-28 11:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-28 11:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-28 11:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404 to the API
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'diesel',
 'id': '9d2535b8-9fd6-519a-a0c4-0e668ad58837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV32404',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 351956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2006}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Saving data for JV32404: {'auction_closing_time': 1774717022.0, 'created_time': 1773400107.858584, 'last_price_update_time': 1774696390.408129}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV32404') HTTP/1.1" 204 0
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for NR64586: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9, identifier: NR64586
2026-03-28 11:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-28 11:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-28 11:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747 to the API
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:32:51Z',
 'fuel_type': 'petrol',
 'id': '4bbc95e2-a1ab-5df4-8482-2c6da3d42c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP47747',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 132429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Opel Combo 1.4 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2009}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Saving data for WP47747: {'auction_closing_time': 1774715571.0, 'created_time': 1773686305.440238, 'last_price_update_time': 1774696390.891446}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP47747') HTTP/1.1" 204 0
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for GF62239: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fa94e8c-48c3-5744-a920-05845ee84e20, identifier: GF62239
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-28 11:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586 to the API
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-28T16:47:40Z',
 'fuel_type': 'diesel',
 'id': '56f36d76-2d8c-5eb9-96ca-6e0a9656daf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR64586',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 104861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2019}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Saving data for NR64586: {'auction_closing_time': 1774716460.0, 'created_time': 1773340269.764206, 'last_price_update_time': 1774696391.374526}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR64586') HTTP/1.1" 204 0
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-28 11:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239 to the API
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:54:50Z',
 'fuel_type': 'diesel',
 'id': '8fa94e8c-48c3-5744-a920-05845ee84e20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF62239',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 179392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-19',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.3 JTD Cult',
 'transmission': 'manual',
 'trim': 'Cult',
 'year': 2014}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Saving data for GF62239: {'auction_closing_time': 1774716890.0, 'created_time': 1773399870.549056, 'last_price_update_time': 1774696391.715772}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF62239') HTTP/1.1" 204 0
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Scrape type for KR34750: 2
2026-03-28 11:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-28 11:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46, identifier: KR34750
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Scrape type for CC75051: 2
2026-03-28 11:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-28 11:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2460f77-95c6-5715-bbc6-95a00bb6111b, identifier: CC75051
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-28 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750 to the API
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:39:07Z',
 'fuel_type': 'petrol',
 'id': '396db2f4-8d9a-5b2b-ba57-f984ed2e0c46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR34750',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Saving data for KR34750: {'auction_closing_time': 1774715947.0, 'created_time': 1773427340.341182, 'last_price_update_time': 1774696392.347782}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR34750') HTTP/1.1" 204 0
2026-03-28 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-28 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-28 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051 to the API
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:02:04Z',
 'fuel_type': 'diesel',
 'id': 'c2460f77-95c6-5715-bbc6-95a00bb6111b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC75051',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 253612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2016}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Saving data for CC75051: {'auction_closing_time': 1774713724.0, 'created_time': 1773732634.766448, 'last_price_update_time': 1774696392.793799}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC75051') HTTP/1.1" 204 0
2026-03-28 11:13:12 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Scrape type for UF21072: 2
2026-03-28 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-28 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ed201d-2143-55a2-99e3-33ebd4607baa, identifier: UF21072
2026-03-28 11:13:12 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Scrape type for AJ85569: 2
2026-03-28 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-28 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f0491a4-301d-5a14-9fc0-017fd1969586, identifier: AJ85569
2026-03-28 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-28 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-28 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072 to the API
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:12:46Z',
 'fuel_type': 'petrol',
 'id': '64ed201d-2143-55a2-99e3-33ebd4607baa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF21072',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 85362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-05',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Saving data for UF21072: {'auction_closing_time': 1774714366.0, 'created_time': 1773307809.842107, 'last_price_update_time': 1774696393.377743}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF21072') HTTP/1.1" 204 0
2026-03-28 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-28 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-28 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569 to the API
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:50Z',
 'fuel_type': 'diesel',
 'id': '6f0491a4-301d-5a14-9fc0-017fd1969586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ85569',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 76827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-04',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Saving data for AJ85569: {'auction_closing_time': 1774714970.0, 'created_time': 1773135031.474286, 'last_price_update_time': 1774696393.706142}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ85569') HTTP/1.1" 204 0
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Scrape type for PB99961: 2
2026-03-28 11:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-28 11:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5556c295-1c7e-5a61-8600-fb12ec46023d, identifier: PB99961
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Scrape type for DC90555: 2
2026-03-28 11:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-28 11:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 332b15ed-913a-5e5b-9834-defa8e804cac, identifier: DC90555
2026-03-28 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-28 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-28 11:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961 to the API
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:00:56Z',
 'fuel_type': 'petrol',
 'id': '5556c295-1c7e-5a61-8600-fb12ec46023d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB99961',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 30840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDI N Performance',
 'transmission': 'automatic',
 'trim': 'N Performance',
 'year': 2022}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Saving data for PB99961: {'auction_closing_time': 1774713656.0, 'created_time': 1773303705.857701, 'last_price_update_time': 1774696394.297279}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB99961') HTTP/1.1" 204 0
2026-03-28 11:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-28 11:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-28 11:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555 to the API
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'diesel',
 'id': '332b15ed-913a-5e5b-9834-defa8e804cac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC90555',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 106358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2016}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Saving data for DC90555: {'auction_closing_time': 1774716148.0, 'created_time': 1774293285.570253, 'last_price_update_time': 1774696394.638962}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC90555') HTTP/1.1" 204 0
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Scrape type for ZM08692: 2
2026-03-28 11:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-28 11:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f7498c-7868-53a3-a7cb-16238f9114c5, identifier: ZM08692
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Scrape type for YF42870: 2
2026-03-28 11:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-28 11:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5, identifier: YF42870
2026-03-28 11:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-28 11:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-28 11:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692 to the API
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:34:35Z',
 'fuel_type': 'diesel',
 'id': '76f7498c-7868-53a3-a7cb-16238f9114c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM08692',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 287320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-01',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Saving data for ZM08692: {'auction_closing_time': 1774715675.0, 'created_time': 1774290637.775782, 'last_price_update_time': 1774696395.260048}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM08692') HTTP/1.1" 204 0
2026-03-28 11:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-28 11:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-28 11:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870 to the API
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:21:32Z',
 'fuel_type': 'diesel',
 'id': '22fa2fb4-7dde-567c-bf1f-357452f9d8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF42870',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 236141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Saving data for YF42870: {'auction_closing_time': 1774714892.0, 'created_time': 1773859512.128462, 'last_price_update_time': 1774696395.668886}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF42870') HTTP/1.1" 204 0
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Scrape type for US46384: 2
2026-03-28 11:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-28 11:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c68b3be-eb31-58f4-a344-c9ce042e75b8, identifier: US46384
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Scrape type for DZ79939: 2
2026-03-28 11:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-28 11:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-28 11:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52deb2f5-a259-59b9-bb91-865725f0cc4a, identifier: DZ79939
2026-03-28 11:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-28 11:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-28 11:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384 to the API
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:38:18Z',
 'fuel_type': 'petrol',
 'id': '7c68b3be-eb31-58f4-a344-c9ce042e75b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US46384',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 84954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-28 11:13:16 [auto1.de] INFO: Saving data for US46384: {'auction_closing_time': 1774715898.0, 'created_time': 1773307201.119595, 'last_price_update_time': 1774696396.659657}
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US46384') HTTP/1.1" 204 0
2026-03-28 11:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-28 11:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-28 11:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939 to the API
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:48:19Z',
 'fuel_type': 'diesel',
 'id': '52deb2f5-a259-59b9-bb91-865725f0cc4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ79939',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 232234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Saving data for DZ79939: {'auction_closing_time': 1774716499.0, 'created_time': 1773134525.548942, 'last_price_update_time': 1774696397.038993}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ79939') HTTP/1.1" 204 0
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Scrape type for ZD02189: 2
2026-03-28 11:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-28 11:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-28 11:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-28 11:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3ed0bce-6b83-5d8d-a4f3-318f90615c49, identifier: ZD02189
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Scrape type for ND02727: 2
2026-03-28 11:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-28 11:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-28 11:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-28 11:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e40ab7-fce8-5160-99be-206fa14f8d8b, identifier: ND02727
2026-03-28 11:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-28 11:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-28 11:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189 to the API
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:27:36Z',
 'fuel_type': 'petrol',
 'id': 'e3ed0bce-6b83-5d8d-a4f3-318f90615c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD02189',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4 S-Cross',
 'odometer': 181219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Saving data for ZD02189: {'auction_closing_time': 1774715256.0, 'created_time': 1773305352.015686, 'last_price_update_time': 1774696397.731786}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD02189') HTTP/1.1" 204 0
2026-03-28 11:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-28 11:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-28 11:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727 to the API
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:16:58Z',
 'fuel_type': 'diesel',
 'id': '93e40ab7-fce8-5160-99be-206fa14f8d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND02727',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 37556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi L1 Active',
 'transmission': 'automatic',
 'trim': 'L1 Active',
 'year': 2023}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Saving data for ND02727: {'auction_closing_time': 1774714618.0, 'created_time': 1774293438.588247, 'last_price_update_time': 1774696398.406586}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND02727') HTTP/1.1" 204 0
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Scrape type for VY61993: 2
2026-03-28 11:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-28 11:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15ca00c4-cff3-5e3d-acc7-803f0f43615c, identifier: VY61993
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 11:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-28 11:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-28 11:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993 to the API
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:46:24Z',
 'fuel_type': 'petrol',
 'id': '15ca00c4-cff3-5e3d-acc7-803f0f43615c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY61993',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 150703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Saving data for VY61993: {'auction_closing_time': 1774716384.0, 'created_time': 1773860188.656103, 'last_price_update_time': 1774696398.942857}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY61993') HTTP/1.1" 204 0
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Scrape type for BP02747: 2
2026-03-28 11:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-28 11:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7734d4b9-6b07-545e-a7ab-6e568f141601, identifier: BP02747
2026-03-28 11:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-28 11:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-28 11:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747 to the API
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:32:41Z',
 'fuel_type': 'petrol',
 'id': '7734d4b9-6b07-545e-a7ab-6e568f141601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP02747',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 10974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-23',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Saving data for BP02747: {'auction_closing_time': 1774715561.0, 'created_time': 1774608305.765001, 'last_price_update_time': 1774696399.474102}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP02747') HTTP/1.1" 204 0
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Scrape type for AN93893: 2
2026-03-28 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-28 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 664a47e5-cdb0-5cb9-adb1-2b35c8758626, identifier: AN93893
2026-03-28 11:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-28 11:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-28 11:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893 to the API
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:13:35Z',
 'fuel_type': 'diesel',
 'id': '664a47e5-cdb0-5cb9-adb1-2b35c8758626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN93893',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 277598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Saving data for AN93893: {'auction_closing_time': 1774714415.0, 'created_time': 1773307951.607186, 'last_price_update_time': 1774696399.888889}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN93893') HTTP/1.1" 204 0
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Scrape type for LC37503: 2
2026-03-28 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-28 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f, identifier: LC37503
2026-03-28 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-28 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-28 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503 to the API
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:26:50Z',
 'fuel_type': 'petrol',
 'id': 'fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC37503',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 118916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-27',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Blu',
 'transmission': 'automatic',
 'trim': 'Blu',
 'year': 2006}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Saving data for LC37503: {'auction_closing_time': 1774715210.0, 'created_time': 1774089252.766841, 'last_price_update_time': 1774696400.358476}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC37503') HTTP/1.1" 204 0
2026-03-28 11:13:20 [auto1.de] INFO: Channel: 24h | Page: 237 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:20 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Scrape type for MG63340: 2
2026-03-28 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-28 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9086c65-31c6-5ae1-8775-d95151bf24ae, identifier: MG63340
2026-03-28 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-28 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-28 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340 to the API
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'diesel',
 'id': 'e9086c65-31c6-5ae1-8775-d95151bf24ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG63340',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 157749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Saving data for MG63340: {'auction_closing_time': 1774715307.0, 'created_time': 1773775150.209452, 'last_price_update_time': 1774696400.911024}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG63340') HTTP/1.1" 204 0
2026-03-28 11:13:20 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Scrape type for RN03307: 2
2026-03-28 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-28 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e6c496e-90ed-5916-932d-74697b3d5865, identifier: RN03307
2026-03-28 11:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Scrape type for AY58726: 2
2026-03-28 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with identifier: AY58726
2026-03-28 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc622f6-2a38-5a05-be7e-7e3636c12f69, identifier: AY58726
2026-03-28 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-28 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-28 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307 to the API
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 389,
 'expiration_date': '2026-03-28T16:48:42Z',
 'fuel_type': 'petrol',
 'id': '9e6c496e-90ed-5916-932d-74697b3d5865',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN03307',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 64737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Saving data for RN03307: {'auction_closing_time': 1774716522.0, 'created_time': 1774264913.648804, 'last_price_update_time': 1774696401.579115}
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN03307') HTTP/1.1" 204 0
2026-03-28 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with identifier: AY58726
2026-03-28 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with identifier: AY58726
2026-03-28 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc622f6-2a38-5a05-be7e-7e3636c12f69 with identifier: AY58726 to the API
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 476,
 'expiration_date': '2026-03-28T16:29:16Z',
 'fuel_type': 'electro',
 'id': '2bc622f6-2a38-5a05-be7e-7e3636c12f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY58726',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Taycan Cross Turismo',
 'odometer': 41855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seller_name': None,
 'title': 'Porsche Taycan Cross Turismo 4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Saving data for AY58726: {'auction_closing_time': 1774715356.0, 'created_time': 1774608294.972456, 'last_price_update_time': 1774696402.104174}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY58726') HTTP/1.1" 204 0
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Scrape type for PG30420: 2
2026-03-28 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-28 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69417ab-3c6b-5403-bb16-59fdad78d7da, identifier: PG30420
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Scrape type for FX88340: 2
2026-03-28 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-28 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: affa8d52-2496-5d6f-9d30-d541e849270e, identifier: FX88340
2026-03-28 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-28 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-28 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420 to the API
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:25Z',
 'fuel_type': 'petrol',
 'id': 'b69417ab-3c6b-5403-bb16-59fdad78d7da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30420',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 163376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Saving data for PG30420: {'auction_closing_time': 1774716325.0, 'created_time': 1773400605.870425, 'last_price_update_time': 1774696402.733725}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG30420') HTTP/1.1" 204 0
2026-03-28 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-28 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-28 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340 to the API
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:36Z',
 'fuel_type': 'diesel',
 'id': 'affa8d52-2496-5d6f-9d30-d541e849270e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX88340',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 232965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for FX88340: {'auction_closing_time': 1774715976.0, 'created_time': 1773303813.950314, 'last_price_update_time': 1774696403.094886}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX88340') HTTP/1.1" 204 0
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Scrape type for NZ32972: 2
2026-03-28 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-28 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d045e022-fae0-51ca-ac59-5b21aaa3acee, identifier: NZ32972
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Scrape type for YH93335: 2
2026-03-28 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-28 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f498da1d-5208-5a84-a2bd-5be7e2af31be, identifier: YH93335
2026-03-28 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-28 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-28 11:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972 to the API
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:48Z',
 'fuel_type': 'petrol',
 'id': 'd045e022-fae0-51ca-ac59-5b21aaa3acee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ32972',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 17377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for NZ32972: {'auction_closing_time': 1774716708.0, 'created_time': 1773136526.977073, 'last_price_update_time': 1774696403.654495}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ32972') HTTP/1.1" 204 0
2026-03-28 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-28 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-28 11:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335 to the API
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:40Z',
 'fuel_type': 'diesel',
 'id': 'f498da1d-5208-5a84-a2bd-5be7e2af31be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH93335',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 103531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for YH93335: {'auction_closing_time': 1774714480.0, 'created_time': 1773134593.0644, 'last_price_update_time': 1774696403.989746}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH93335') HTTP/1.1" 204 0
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for TH91647: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16c36ef-11c6-5a37-9bae-dba3598991ec, identifier: TH91647
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for AH95980: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4adea14b-accc-50ee-8651-ac60449ee690, identifier: AH95980
2026-03-28 11:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-28 11:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-28 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647 to the API
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:08:03Z',
 'fuel_type': 'petrol',
 'id': 'b16c36ef-11c6-5a37-9bae-dba3598991ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH91647',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 44119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Saving data for TH91647: {'auction_closing_time': 1774714083.0, 'created_time': 1774262980.476949, 'last_price_update_time': 1774696404.523084}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH91647') HTTP/1.1" 204 0
2026-03-28 11:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-28 11:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-28 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980 to the API
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:20:37Z',
 'fuel_type': 'diesel',
 'id': '4adea14b-accc-50ee-8651-ac60449ee690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH95980',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 179753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Saving data for AH95980: {'auction_closing_time': 1774714837.0, 'created_time': 1773400587.35671, 'last_price_update_time': 1774696404.82109}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH95980') HTTP/1.1" 204 0
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for MF45027: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c401126b-fee5-592a-863c-040d7aab7840, identifier: MF45027
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for WF31302: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a1c824-b6c6-5859-ad64-3897eff2c470, identifier: WF31302
2026-03-28 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-28 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-28 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027 to the API
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:09:16Z',
 'fuel_type': 'diesel',
 'id': 'c401126b-fee5-592a-863c-040d7aab7840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF45027',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2015}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Saving data for MF45027: {'auction_closing_time': 1774714156.0, 'created_time': 1773469059.546648, 'last_price_update_time': 1774696405.357545}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF45027') HTTP/1.1" 204 0
2026-03-28 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-28 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-28 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302 to the API
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:25:51Z',
 'fuel_type': 'diesel',
 'id': 'e3a1c824-b6c6-5859-ad64-3897eff2c470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF31302',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 128456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Saving data for WF31302: {'auction_closing_time': 1774715151.0, 'created_time': 1773859696.763573, 'last_price_update_time': 1774696405.820778}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF31302') HTTP/1.1" 204 0
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Scrape type for MY29921: 2
2026-03-28 11:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-28 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2, identifier: MY29921
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Scrape type for AR05539: 2
2026-03-28 11:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-28 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02753508-7a13-5340-8199-ecb2445c458c, identifier: AR05539
2026-03-28 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-28 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-28 11:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921 to the API
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'diesel',
 'id': '32d5e899-fa8a-53c8-a15b-f7e8611c50b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY29921',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 197127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Saving data for MY29921: {'auction_closing_time': 1774715674.0, 'created_time': 1774293283.051733, 'last_price_update_time': 1774696406.455989}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY29921') HTTP/1.1" 204 0
2026-03-28 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-28 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-28 11:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539 to the API
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'petrol',
 'id': '02753508-7a13-5340-8199-ecb2445c458c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR05539',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 105365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-14',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2015}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Saving data for AR05539: {'auction_closing_time': 1774717191.0, 'created_time': 1773646299.143922, 'last_price_update_time': 1774696406.874536}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR05539') HTTP/1.1" 204 0
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Scrape type for ST57334: 2
2026-03-28 11:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-28 11:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b112174-d592-554e-a407-4790f8c9a958, identifier: ST57334
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Scrape type for YM46431: 2
2026-03-28 11:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-28 11:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7, identifier: YM46431
2026-03-28 11:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-28 11:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-28 11:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334 to the API
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:40:26Z',
 'fuel_type': 'diesel',
 'id': '1b112174-d592-554e-a407-4790f8c9a958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST57334',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 428121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-02',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Saving data for ST57334: {'auction_closing_time': 1774716026.0, 'created_time': 1773302038.931624, 'last_price_update_time': 1774696407.549986}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST57334') HTTP/1.1" 204 0
2026-03-28 11:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-28 11:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-28 11:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431 to the API
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:21Z',
 'fuel_type': 'diesel',
 'id': '9729b520-1d3e-5d9c-a5a3-3a73e6f381d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM46431',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 97376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 3,0t (8/9 Sitze) Life',
 'transmission': 'manual',
 'trim': 'L2H1 3,0t (8/9 Sitze) Life',
 'year': 2020}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Saving data for YM46431: {'auction_closing_time': 1774715841.0, 'created_time': 1773467120.923954, 'last_price_update_time': 1774696407.92859}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM46431') HTTP/1.1" 204 0
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Scrape type for ZM90265: 2
2026-03-28 11:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-28 11:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb9f406f-1672-5d49-ad7d-6a9d7761bfab with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb9f406f-1672-5d49-ad7d-6a9d7761bfab with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb9f406f-1672-5d49-ad7d-6a9d7761bfab, identifier: ZM90265
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-28 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-28 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265 to the API
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:48:07Z',
 'fuel_type': 'diesel',
 'id': 'eb9f406f-1672-5d49-ad7d-6a9d7761bfab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM90265',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 270846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-07',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Saving data for ZM90265: {'auction_closing_time': 1774716487.0, 'created_time': 1773303624.698193, 'last_price_update_time': 1774696408.366376}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM90265') HTTP/1.1" 204 0
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Scrape type for YM28187: 2
2026-03-28 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-28 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd055fb-d3ec-56d5-ae56-745aea36fed8, identifier: YM28187
2026-03-28 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-28 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-28 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187 to the API
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:04Z',
 'fuel_type': 'diesel',
 'id': 'abd055fb-d3ec-56d5-ae56-745aea36fed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM28187',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 315309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-22',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Saving data for YM28187: {'auction_closing_time': 1774714744.0, 'created_time': 1774032102.134897, 'last_price_update_time': 1774696408.889398}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM28187') HTTP/1.1" 204 0
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Scrape type for UD14847: 2
2026-03-28 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-28 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84f3d58e-c0bb-5e60-934b-ebe9742324a8, identifier: UD14847
2026-03-28 11:13:29 [auto1.de] INFO: Channel: 24h | Page: 238 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-28 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-28 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847 to the API
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:51:49Z',
 'fuel_type': 'petrol',
 'id': '84f3d58e-c0bb-5e60-934b-ebe9742324a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD14847',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 81152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Saving data for UD14847: {'auction_closing_time': 1774716709.0, 'created_time': 1773427501.291969, 'last_price_update_time': 1774696409.294606}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD14847') HTTP/1.1" 204 0
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Scrape type for PA85998: 2
2026-03-28 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-28 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae1811e-78e3-526d-8183-9a67084a9e5d, identifier: PA85998
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ91996%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Scrape type for BJ91996: 0
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Scrape type for AB14083: 2
2026-03-28 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-28 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7befd98-7c74-5aef-985d-5b661a3028ac, identifier: AB14083
2026-03-28 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-28 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-28 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998 to the API
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'petrol',
 'id': '1ae1811e-78e3-526d-8183-9a67084a9e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA85998',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 86426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
 'transmission': 'automatic',
 'trim': 'T 4Matic+',
 'year': 2019}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Saving data for PA85998: {'auction_closing_time': 1774714788.0, 'created_time': 1774608306.619479, 'last_price_update_time': 1774696409.881555}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA85998') HTTP/1.1" 204 0
2026-03-28 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-28 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-28 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083 to the API
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:28:51Z',
 'fuel_type': 'petrol',
 'id': 'f7befd98-7c74-5aef-985d-5b661a3028ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB14083',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 116246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-21',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Saving data for AB14083: {'auction_closing_time': 1774715331.0, 'created_time': 1774031485.470664, 'last_price_update_time': 1774696410.183485}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB14083') HTTP/1.1" 204 0
2026-03-28 11:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:30 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Scrape type for VX06464: 2
2026-03-28 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-28 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d, identifier: VX06464
2026-03-28 11:13:30 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Scrape type for HL71363: 2
2026-03-28 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-28 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed3b527b-ba2e-5a21-947c-98087d16aa66, identifier: HL71363
2026-03-28 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-28 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-28 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464 to the API
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:02:47Z',
 'fuel_type': 'diesel',
 'id': '0fbad728-be3a-5d7e-9e5c-c557b0dae75d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06464',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 207928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Audi A4 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Saving data for VX06464: {'auction_closing_time': 1774713767.0, 'created_time': 1773469108.653736, 'last_price_update_time': 1774696410.800863}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06464') HTTP/1.1" 204 0
2026-03-28 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-28 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-28 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363 to the API
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'diesel',
 'id': 'ed3b527b-ba2e-5a21-947c-98087d16aa66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL71363',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 137709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-06',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Saving data for HL71363: {'auction_closing_time': 1774714236.0, 'created_time': 1773137201.201656, 'last_price_update_time': 1774696411.408687}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL71363') HTTP/1.1" 204 0
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Scrape type for EC48687: 2
2026-03-28 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-28 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587d2463-16dd-5ce4-9511-ad98f4accfc3 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587d2463-16dd-5ce4-9511-ad98f4accfc3 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 587d2463-16dd-5ce4-9511-ad98f4accfc3, identifier: EC48687
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Scrape type for GH57189: 2
2026-03-28 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-28 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a452c62-5846-5434-b548-48af8e4b2f83, identifier: GH57189
2026-03-28 11:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-28 11:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-28 11:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687 to the API
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:40:43Z',
 'fuel_type': 'diesel',
 'id': '587d2463-16dd-5ce4-9511-ad98f4accfc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC48687',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 180092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Saving data for EC48687: {'auction_closing_time': 1774716043.0, 'created_time': 1774608277.146232, 'last_price_update_time': 1774696411.997872}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC48687') HTTP/1.1" 204 0
2026-03-28 11:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-28 11:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-28 11:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189 to the API
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:27:01Z',
 'fuel_type': 'petrol',
 'id': '4a452c62-5846-5434-b548-48af8e4b2f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH57189',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 132974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2009}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Saving data for GH57189: {'auction_closing_time': 1774715221.0, 'created_time': 1774608455.447389, 'last_price_update_time': 1774696412.437019}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH57189') HTTP/1.1" 204 0
2026-03-28 11:13:32 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Scrape type for VC27283: 2
2026-03-28 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-28 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35, identifier: VC27283
2026-03-28 11:13:32 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 11:13:32 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Scrape type for NB18835: 2
2026-03-28 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-28 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 301d0d97-cfe5-54fa-bad8-2e8164c9b338, identifier: NB18835
2026-03-28 11:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-28 11:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-28 11:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283 to the API
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'petrol',
 'id': '56c069a6-f7b9-51ee-9bdc-a390d4ed5b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC27283',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 61070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2007}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Saving data for VC27283: {'auction_closing_time': 1774715302.0, 'created_time': 1774608290.12719, 'last_price_update_time': 1774696413.088999}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC27283') HTTP/1.1" 204 0
2026-03-28 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-28 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-28 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835 to the API
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:08:28Z',
 'fuel_type': 'diesel',
 'id': '301d0d97-cfe5-54fa-bad8-2e8164c9b338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB18835',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-08',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Saving data for NB18835: {'auction_closing_time': 1774714108.0, 'created_time': 1774608273.974255, 'last_price_update_time': 1774696413.396268}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB18835') HTTP/1.1" 204 0
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Scrape type for KR59987: 2
2026-03-28 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-28 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b94ba28-32bf-5e16-b129-66d1a51e379c, identifier: KR59987
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Scrape type for CR29385: 2
2026-03-28 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-28 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3d4731-f68c-59c7-9a4c-4f683965d7df with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3d4731-f68c-59c7-9a4c-4f683965d7df with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac3d4731-f68c-59c7-9a4c-4f683965d7df, identifier: CR29385
2026-03-28 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-28 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-28 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987 to the API
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:15:55Z',
 'fuel_type': 'petrol',
 'id': '2b94ba28-32bf-5e16-b129-66d1a51e379c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR59987',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 186064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-16',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Saving data for KR59987: {'auction_closing_time': 1774714555.0, 'created_time': 1773660381.20251, 'last_price_update_time': 1774696414.024148}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR59987') HTTP/1.1" 204 0
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-28 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385 to the API
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-28T16:54:22Z',
 'fuel_type': 'petrol',
 'id': 'ac3d4731-f68c-59c7-9a4c-4f683965d7df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR29385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 34263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2022}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Saving data for CR29385: {'auction_closing_time': 1774716862.0, 'created_time': 1774608327.545426, 'last_price_update_time': 1774696414.380958}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR29385') HTTP/1.1" 204 0
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Scrape type for BX38798: 2
2026-03-28 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-28 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e, identifier: BX38798
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Scrape type for GD61504: 2
2026-03-28 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-28 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58, identifier: GD61504
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-28 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798 to the API
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'diesel',
 'id': '3bd4c0a3-c14e-5839-95e1-2832184b0c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX38798',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 320728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-20',
 'seller_name': None,
 'title': 'Audi A4 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Saving data for BX38798: {'auction_closing_time': 1774714631.0, 'created_time': 1774349907.772821, 'last_price_update_time': 1774696414.938689}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX38798') HTTP/1.1" 204 0
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-28 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504 to the API
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:30Z',
 'fuel_type': 'diesel',
 'id': '6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61504',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 202964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-29',
 'seller_name': None,
 'title': 'Renault Trafic 1.9 Diesel L1H1 2,7t verglast',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t verglast',
 'year': 2006}
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Saving data for GD61504: {'auction_closing_time': 1774715670.0, 'created_time': 1774608284.094619, 'last_price_update_time': 1774696415.273205}
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61504') HTTP/1.1" 204 0
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Scrape type for RT05682: 2
2026-03-28 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-28 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc6dbdf-847a-5680-8619-92b0c7391726 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc6dbdf-847a-5680-8619-92b0c7391726 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbc6dbdf-847a-5680-8619-92b0c7391726, identifier: RT05682
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Scrape type for LM89812: 2
2026-03-28 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-28 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09, identifier: LM89812
2026-03-28 11:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-28 11:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-28 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682 to the API
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:19:00Z',
 'fuel_type': 'diesel',
 'id': 'fbc6dbdf-847a-5680-8619-92b0c7391726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT05682',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 265381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2013}
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-28 11:13:36 [auto1.de] INFO: Saving data for RT05682: {'auction_closing_time': 1774714740.0, 'created_time': 1774608291.353218, 'last_price_update_time': 1774696416.696564}
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT05682') HTTP/1.1" 204 0
2026-03-28 11:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-28 11:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-28 11:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812 to the API
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:32Z',
 'fuel_type': 'diesel',
 'id': '8b7c7c3b-1990-537a-8d75-d46f7fda4b09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM89812',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 247375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-12',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for LM89812: {'auction_closing_time': 1774715732.0, 'created_time': 1774608333.388092, 'last_price_update_time': 1774696417.113757}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM89812') HTTP/1.1" 204 0
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for EN46705: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3640239-69bd-5ce3-877b-7f4b6ed81c7a, identifier: EN46705
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for MC56654: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf, identifier: MC56654
2026-03-28 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-28 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-28 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705 to the API
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:07Z',
 'fuel_type': 'diesel',
 'id': 'f3640239-69bd-5ce3-877b-7f4b6ed81c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN46705',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 368178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2017}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for EN46705: {'auction_closing_time': 1774717027.0, 'created_time': 1774608351.743091, 'last_price_update_time': 1774696417.654253}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN46705') HTTP/1.1" 204 0
2026-03-28 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-28 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-28 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654 to the API
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:58Z',
 'fuel_type': 'petrol',
 'id': '14d0a9af-cc96-503d-9d3a-9fe700bd2ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC56654',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 49058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for MC56654: {'auction_closing_time': 1774715878.0, 'created_time': 1773775223.190521, 'last_price_update_time': 1774696417.947808}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC56654') HTTP/1.1" 204 0
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for FZ50846: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a4de99-3012-53c2-b8d4-49627de505f8, identifier: FZ50846
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Scrape type for ZE75344: 2
2026-03-28 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-28 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0b3edc3-54ee-5d10-a257-8964ec12603e, identifier: ZE75344
2026-03-28 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-28 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-28 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846 to the API
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:43Z',
 'fuel_type': 'diesel',
 'id': '43a4de99-3012-53c2-b8d4-49627de505f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ50846',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 370587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2014}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Saving data for FZ50846: {'auction_closing_time': 1774717123.0, 'created_time': 1773138597.046821, 'last_price_update_time': 1774696418.546742}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ50846') HTTP/1.1" 204 0
2026-03-28 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-28 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-28 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344 to the API
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'petrol',
 'id': 'd0b3edc3-54ee-5d10-a257-8964ec12603e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE75344',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 220560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Saving data for ZE75344: {'auction_closing_time': 1774714738.0, 'created_time': 1774608339.267499, 'last_price_update_time': 1774696418.954579}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE75344') HTTP/1.1" 204 0
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Scrape type for ZS04919: 2
2026-03-28 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-28 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2a5b396-8d7a-5214-9a29-2b008151704c, identifier: ZS04919
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Scrape type for JR97371: 2
2026-03-28 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-28 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee31247-563d-5d39-9604-3c7d8bea3d43, identifier: JR97371
2026-03-28 11:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-28 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-28 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919 to the API
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:06:38Z',
 'fuel_type': 'hybrid',
 'id': 'e2a5b396-8d7a-5214-9a29-2b008151704c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS04919',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 135599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2015}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Saving data for ZS04919: {'auction_closing_time': 1774713998.0, 'created_time': 1774608281.583698, 'last_price_update_time': 1774696419.555024}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS04919') HTTP/1.1" 204 0
2026-03-28 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-28 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-28 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371 to the API
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:05Z',
 'fuel_type': 'diesel',
 'id': '3ee31247-563d-5d39-9604-3c7d8bea3d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR97371',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 201428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'manual',
 'trim': 'Scout 4x4',
 'year': 2010}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Saving data for JR97371: {'auction_closing_time': 1774717085.0, 'created_time': 1773905443.219309, 'last_price_update_time': 1774696419.896709}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR97371') HTTP/1.1" 204 0
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Scrape type for RM03411: 2
2026-03-28 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-28 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f71a3a4-afe0-50b4-9484-c3763ef3d681, identifier: RM03411
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Scrape type for XJ62576: 2
2026-03-28 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-28 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a80eae5e-5aca-57a8-90ad-f7cd28bef639, identifier: XJ62576
2026-03-28 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-28 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-28 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411 to the API
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:39Z',
 'fuel_type': 'diesel',
 'id': '0f71a3a4-afe0-50b4-9484-c3763ef3d681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM03411',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 157444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Saving data for RM03411: {'auction_closing_time': 1774716159.0, 'created_time': 1774608282.501107, 'last_price_update_time': 1774696420.46674}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM03411') HTTP/1.1" 204 0
2026-03-28 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-28 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-28 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576 to the API
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:40Z',
 'fuel_type': 'petrol',
 'id': 'a80eae5e-5aca-57a8-90ad-f7cd28bef639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ62576',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 260278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Saving data for XJ62576: {'auction_closing_time': 1774715140.0, 'created_time': 1774608385.576119, 'last_price_update_time': 1774696420.803157}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ62576') HTTP/1.1" 204 0
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Scrape type for VR34423: 2
2026-03-28 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-28 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53439014-b8b9-5213-b2c2-2a1af04affbd, identifier: VR34423
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Scrape type for XX83628: 2
2026-03-28 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-28 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71677453-e954-5857-8232-c903da3363c8, identifier: XX83628
2026-03-28 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-28 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-28 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423 to the API
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:34:55Z',
 'fuel_type': 'petrol',
 'id': '53439014-b8b9-5213-b2c2-2a1af04affbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR34423',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 95976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Saving data for VR34423: {'auction_closing_time': 1774715695.0, 'created_time': 1773429146.409993, 'last_price_update_time': 1774696421.421114}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR34423') HTTP/1.1" 204 0
2026-03-28 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-28 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-28 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628 to the API
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:37:50Z',
 'fuel_type': 'petrol',
 'id': '71677453-e954-5857-8232-c903da3363c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX83628',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 120611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2009}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Saving data for XX83628: {'auction_closing_time': 1774715870.0, 'created_time': 1774608337.976488, 'last_price_update_time': 1774696421.816626}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX83628') HTTP/1.1" 204 0
2026-03-28 11:13:41 [auto1.de] INFO: Channel: 24h | Page: 239 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Scrape type for DM13382: 2
2026-03-28 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-28 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c10f829-a6be-5740-bd57-74517d6a4f59, identifier: DM13382
2026-03-28 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-28 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:06Z',
 'fuel_type': 'petrol',
 'id': '8c10f829-a6be-5740-bd57-74517d6a4f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM13382',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 90029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2018}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Saving data for DM13382: {'auction_closing_time': 1774714506.0, 'created_time': 1773307254.364152, 'last_price_update_time': 1774696422.286679}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM13382') HTTP/1.1" 204 0
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Scrape type for SR08314: 2
2026-03-28 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-28 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8, identifier: SR08314
2026-03-28 11:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Scrape type for CC90437: 2
2026-03-28 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-28 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2ef1a69-26e0-5da2-8f15-15a8e19856da with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2ef1a69-26e0-5da2-8f15-15a8e19856da with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2ef1a69-26e0-5da2-8f15-15a8e19856da, identifier: CC90437
2026-03-28 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-28 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:43:52Z',
 'fuel_type': 'diesel',
 'id': '0abbd100-4ddd-588c-a609-5c7bb2c6a7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR08314',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 436322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.7 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Saving data for SR08314: {'auction_closing_time': 1774716232.0, 'created_time': 1773136891.848533, 'last_price_update_time': 1774696422.845979}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR08314') HTTP/1.1" 204 0
2026-03-28 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-28 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:49Z',
 'fuel_type': 'petrol',
 'id': 'd2ef1a69-26e0-5da2-8f15-15a8e19856da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 157404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Saving data for CC90437: {'auction_closing_time': 1774716589.0, 'created_time': 1774608292.10542, 'last_price_update_time': 1774696423.156983}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC90437') HTTP/1.1" 204 0
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Scrape type for JS15071: 2
2026-03-28 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-28 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b83dec2-b487-594e-97d3-b14e6d0ff478 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b83dec2-b487-594e-97d3-b14e6d0ff478 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b83dec2-b487-594e-97d3-b14e6d0ff478, identifier: JS15071
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Scrape type for SM08668: 2
2026-03-28 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-28 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87c6f58-a769-523f-aec0-bcf43d0b5d86 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d87c6f58-a769-523f-aec0-bcf43d0b5d86 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d87c6f58-a769-523f-aec0-bcf43d0b5d86, identifier: SM08668
2026-03-28 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-28 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-28 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071 to the API
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:18Z',
 'fuel_type': 'diesel',
 'id': '5b83dec2-b487-594e-97d3-b14e6d0ff478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS15071',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 319345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
 'transmission': 'manual',
 'trim': 'Laurin & Klement',
 'year': 2009}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Saving data for JS15071: {'auction_closing_time': 1774713798.0, 'created_time': 1774608300.700682, 'last_price_update_time': 1774696423.711886}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS15071') HTTP/1.1" 204 0
2026-03-28 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-28 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-28 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668 to the API
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:43:27Z',
 'fuel_type': 'diesel',
 'id': 'd87c6f58-a769-523f-aec0-bcf43d0b5d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM08668',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 271191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Volkswagen Jetta 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for SM08668: {'auction_closing_time': 1774716207.0, 'created_time': 1774608284.772688, 'last_price_update_time': 1774696424.130241}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM08668') HTTP/1.1" 204 0
2026-03-28 11:13:44 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 11:13:44 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Scrape type for CD13649: 2
2026-03-28 11:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-28 11:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8878daf-9971-5dc8-a305-139ef2024c2d, identifier: CD13649
2026-03-28 11:13:44 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Scrape type for ND31150: 2
2026-03-28 11:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-28 11:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647873b0-8b19-5fc8-8d65-b4144ffff44c with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647873b0-8b19-5fc8-8d65-b4144ffff44c with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647873b0-8b19-5fc8-8d65-b4144ffff44c, identifier: ND31150
2026-03-28 11:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-28 11:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-28 11:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649 to the API
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:31Z',
 'fuel_type': 'petrol',
 'id': 'b8878daf-9971-5dc8-a305-139ef2024c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD13649',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2012}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for CD13649: {'auction_closing_time': 1774713871.0, 'created_time': 1774608302.293486, 'last_price_update_time': 1774696424.68859}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD13649') HTTP/1.1" 204 0
2026-03-28 11:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-28 11:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-28 11:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150 to the API
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:23:36Z',
 'fuel_type': 'petrol',
 'id': '647873b0-8b19-5fc8-8d65-b4144ffff44c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND31150',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 224153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-03',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2014}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for ND31150: {'auction_closing_time': 1774715016.0, 'created_time': 1773830252.512512, 'last_price_update_time': 1774696424.991831}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND31150') HTTP/1.1" 204 0
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Scrape type for HR10791: 2
2026-03-28 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-28 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c12cc02-5c90-503f-b86d-3517fb83850b, identifier: HR10791
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Scrape type for YB40017: 2
2026-03-28 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-28 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62335a8b-68e1-5bb9-af11-29207488c39c with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62335a8b-68e1-5bb9-af11-29207488c39c with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62335a8b-68e1-5bb9-af11-29207488c39c, identifier: YB40017
2026-03-28 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-28 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-28 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791 to the API
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:33Z',
 'fuel_type': 'diesel',
 'id': '2c12cc02-5c90-503f-b86d-3517fb83850b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR10791',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 108952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'automatic',
 'trim': 'Center-Line 2WD',
 'year': 2012}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Saving data for HR10791: {'auction_closing_time': 1774716213.0, 'created_time': 1774032298.734091, 'last_price_update_time': 1774696425.570503}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR10791') HTTP/1.1" 204 0
2026-03-28 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-28 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-28 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017 to the API
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:10:35Z',
 'fuel_type': 'petrol',
 'id': '62335a8b-68e1-5bb9-af11-29207488c39c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB40017',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 124323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Saving data for YB40017: {'auction_closing_time': 1774714235.0, 'created_time': 1774608287.495337, 'last_price_update_time': 1774696425.996658}
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB40017') HTTP/1.1" 204 0
2026-03-28 11:13:46 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-28 11:13:46 [auto1.de] INFO: Scrape type for GS36326: 2
2026-03-28 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-28 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa3dfa2-760d-5565-9835-4eb8359113a9 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aa3dfa2-760d-5565-9835-4eb8359113a9 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aa3dfa2-760d-5565-9835-4eb8359113a9, identifier: GS36326
2026-03-28 11:13:46 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-28 11:13:46 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 11:13:46 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-28 11:13:46 [auto1.de] INFO: Scrape type for YB62347: 2
2026-03-28 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-28 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10a7be19-c2b6-534e-a5df-66b929f96b56, identifier: YB62347
2026-03-28 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-28 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-28 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326 to the API
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:27:44Z',
 'fuel_type': 'petrol',
 'id': '7aa3dfa2-760d-5565-9835-4eb8359113a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36326',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 67479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-28 11:13:46 [auto1.de] INFO: Saving data for GS36326: {'auction_closing_time': 1774715264.0, 'created_time': 1774608304.55713, 'last_price_update_time': 1774696426.684927}
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36326') HTTP/1.1" 204 0
2026-03-28 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-28 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-28 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347 to the API
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:08Z',
 'fuel_type': 'diesel',
 'id': '10a7be19-c2b6-534e-a5df-66b929f96b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB62347',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 172224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Saving data for YB62347: {'auction_closing_time': 1774714028.0, 'created_time': 1773131812.575725, 'last_price_update_time': 1774696427.155288}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB62347') HTTP/1.1" 204 0
2026-03-28 11:13:47 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-28 11:13:47 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Scrape type for FR75488: 2
2026-03-28 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-28 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe13bc0-dc06-5624-94cf-849fa19e3edc with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe13bc0-dc06-5624-94cf-849fa19e3edc with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbe13bc0-dc06-5624-94cf-849fa19e3edc, identifier: FR75488
2026-03-28 11:13:47 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Scrape type for UY13477: 2
2026-03-28 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-28 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4, identifier: UY13477
2026-03-28 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-28 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-28 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488 to the API
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:30:46Z',
 'fuel_type': 'petrol',
 'id': 'bbe13bc0-dc06-5624-94cf-849fa19e3edc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR75488',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 191110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-24',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2005}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Saving data for FR75488: {'auction_closing_time': 1774715446.0, 'created_time': 1774379799.759491, 'last_price_update_time': 1774696427.859158}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR75488') HTTP/1.1" 204 0
2026-03-28 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-28 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-28 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477 to the API
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:21:56Z',
 'fuel_type': 'petrol',
 'id': '4bf5f630-2a72-5211-aa24-f6dda42ac5a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY13477',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 156419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Saving data for UY13477: {'auction_closing_time': 1774714916.0, 'created_time': 1774608335.531029, 'last_price_update_time': 1774696428.18826}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY13477') HTTP/1.1" 204 0
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Scrape type for MD11027: 2
2026-03-28 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-28 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f509094e-1301-5c23-87ef-a32a3b69de00, identifier: MD11027
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-28 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-28 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-28 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027 to the API
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:45:07Z',
 'fuel_type': 'petrol',
 'id': 'f509094e-1301-5c23-87ef-a32a3b69de00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD11027',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 117455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.8 TSI Highline Aktionsmodell T',
 'transmission': 'manual',
 'trim': 'Highline Aktionsmodell T',
 'year': 2009}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Saving data for MD11027: {'auction_closing_time': 1774716307.0, 'created_time': 1773830356.094439, 'last_price_update_time': 1774696428.643209}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD11027') HTTP/1.1" 204 0
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Scrape type for VT63702: 2
2026-03-28 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-28 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00, identifier: VT63702
2026-03-28 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-28 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-28 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702 to the API
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:20:21Z',
 'fuel_type': 'petrol',
 'id': 'a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT63702',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 157260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Saving data for VT63702: {'auction_closing_time': 1774714821.0, 'created_time': 1774379809.67208, 'last_price_update_time': 1774696429.089975}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT63702') HTTP/1.1" 204 0
2026-03-28 11:13:49 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 11:13:49 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Scrape type for SU14933: 2
2026-03-28 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-28 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377020e3-82f1-5202-81e0-f3132a469aac with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 377020e3-82f1-5202-81e0-f3132a469aac with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 377020e3-82f1-5202-81e0-f3132a469aac, identifier: SU14933
2026-03-28 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-28 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-28 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933 to the API
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'petrol',
 'id': '377020e3-82f1-5202-81e0-f3132a469aac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU14933',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 213715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Saving data for SU14933: {'auction_closing_time': 1774715067.0, 'created_time': 1774379681.770233, 'last_price_update_time': 1774696429.556422}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU14933') HTTP/1.1" 204 0
2026-03-28 11:13:49 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Scrape type for LG62730: 2
2026-03-28 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-28 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, identifier: LG62730
2026-03-28 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-28 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-28 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730 to the API
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:02:18Z',
 'fuel_type': 'diesel',
 'id': '7c51b62c-b60d-5b31-ab3f-a150e7de0a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG62730',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 146872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2018}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Saving data for LG62730: {'auction_closing_time': 1774713738.0, 'created_time': 1774608294.151967, 'last_price_update_time': 1774696430.004514}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG62730') HTTP/1.1" 204 0
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Scrape type for JH21308: 2
2026-03-28 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-28 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23b91a1-eda2-53eb-b8ac-64b47f7760bc, identifier: JH21308
2026-03-28 11:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-28 11:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-28 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308 to the API
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:46Z',
 'fuel_type': 'petrol',
 'id': 'f23b91a1-eda2-53eb-b8ac-64b47f7760bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH21308',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 25372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 200 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Saving data for JH21308: {'auction_closing_time': 1774717006.0, 'created_time': 1774034477.494268, 'last_price_update_time': 1774696430.581179}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH21308') HTTP/1.1" 204 0
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Scrape type for HB31061: 2
2026-03-28 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-28 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e8b967-8a3d-51fd-b23b-05555d728276 with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e8b967-8a3d-51fd-b23b-05555d728276 with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e8b967-8a3d-51fd-b23b-05555d728276, identifier: HB31061
2026-03-28 11:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-28 11:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-28 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061 to the API
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:15:05Z',
 'fuel_type': 'petrol',
 'id': '83e8b967-8a3d-51fd-b23b-05555d728276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB31061',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 112719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Saving data for HB31061: {'auction_closing_time': 1774714505.0, 'created_time': 1774608341.52851, 'last_price_update_time': 1774696431.021451}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB31061') HTTP/1.1" 204 0
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Scrape type for AB88110: 2
2026-03-28 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-28 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a, identifier: AB88110
2026-03-28 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-28 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-28 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110 to the API
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:43:40Z',
 'fuel_type': 'diesel',
 'id': '5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB88110',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 222846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive 4x4',
 'transmission': 'automatic',
 'trim': 'Exclusive 4x4',
 'year': 2015}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Saving data for AB88110: {'auction_closing_time': 1774716220.0, 'created_time': 1774608305.174039, 'last_price_update_time': 1774696431.451454}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB88110') HTTP/1.1" 204 0
2026-03-28 11:13:51 [auto1.de] INFO: Channel: 24h | Page: 240 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Scrape type for GP68218: 2
2026-03-28 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-28 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab566936-0092-5264-b538-249375a3f4db, identifier: GP68218
2026-03-28 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-28 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-28 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218 to the API
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:46Z',
 'fuel_type': 'petrol',
 'id': 'ab566936-0092-5264-b538-249375a3f4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP68218',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 164483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-07',
 'seller_name': None,
 'title': 'Kia Soul 1.6 GDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2012}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Saving data for GP68218: {'auction_closing_time': 1774715146.0, 'created_time': 1774608319.837379, 'last_price_update_time': 1774696431.859033}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP68218') HTTP/1.1" 204 0
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Scrape type for JL91815: 2
2026-03-28 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-28 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93b4b4e9-50cb-5882-b364-b47601ed4dc6, identifier: JL91815
2026-03-28 11:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Scrape type for WZ51755: 2
2026-03-28 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-28 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e, identifier: WZ51755
2026-03-28 11:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-28 11:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-28 11:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815 to the API
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:13:21Z',
 'fuel_type': 'petrol',
 'id': '93b4b4e9-50cb-5882-b364-b47601ed4dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL91815',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 88428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Saving data for JL91815: {'auction_closing_time': 1774714401.0, 'created_time': 1774608340.673145, 'last_price_update_time': 1774696432.378171}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL91815') HTTP/1.1" 204 0
2026-03-28 11:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-28 11:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-28 11:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755 to the API
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:52:33Z',
 'fuel_type': 'diesel',
 'id': '9a1c756a-fc9e-5f31-b748-beab7ccd8e3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ51755',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 189755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-06',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Saving data for WZ51755: {'auction_closing_time': 1774716753.0, 'created_time': 1774608303.301252, 'last_price_update_time': 1774696432.754527}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ51755') HTTP/1.1" 204 0
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Scrape type for PC18756: 2
2026-03-28 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-28 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80df274c-a93f-54c8-adef-645a79f63b7f, identifier: PC18756
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Scrape type for AE42693: 2
2026-03-28 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-28 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38a77704-a115-57a5-8d8e-81e4c93c25b3, identifier: AE42693
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-28 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756 to the API
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:30:33Z',
 'fuel_type': 'petrol',
 'id': '80df274c-a93f-54c8-adef-645a79f63b7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC18756',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 172830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Saving data for PC18756: {'auction_closing_time': 1774715433.0, 'created_time': 1774349703.429225, 'last_price_update_time': 1774696433.368471}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC18756') HTTP/1.1" 204 0
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-28 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693 to the API
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:54:09Z',
 'fuel_type': 'diesel',
 'id': '38a77704-a115-57a5-8d8e-81e4c93c25b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE42693',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 86474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2018}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Saving data for AE42693: {'auction_closing_time': 1774716849.0, 'created_time': 1773138906.562178, 'last_price_update_time': 1774696433.66971}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE42693') HTTP/1.1" 204 0
2026-03-28 11:13:53 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Scrape type for AY57435: 2
2026-03-28 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-28 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68658590-2bbf-5ac0-bea9-29e94c7e6106, identifier: AY57435
2026-03-28 11:13:53 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Scrape type for DK89074: 2
2026-03-28 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-28 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23de73ab-f3f2-5907-acaa-45b867a47b4b, identifier: DK89074
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:22Z',
 'fuel_type': 'petrol',
 'id': '68658590-2bbf-5ac0-bea9-29e94c7e6106',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY57435',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 80979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'Toyota Auris 1.3 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2016}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Saving data for AY57435: {'auction_closing_time': 1774716142.0, 'created_time': 1774608339.877896, 'last_price_update_time': 1774696434.18439}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY57435') HTTP/1.1" 204 0
2026-03-28 11:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-28 11:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:10:51Z',
 'fuel_type': 'petrol',
 'id': '23de73ab-f3f2-5907-acaa-45b867a47b4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK89074',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 197846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Saving data for DK89074: {'auction_closing_time': 1774714251.0, 'created_time': 1773132202.410904, 'last_price_update_time': 1774696434.541642}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK89074') HTTP/1.1" 204 0
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Scrape type for PJ38214: 2
2026-03-28 11:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-28 11:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad, identifier: PJ38214
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Scrape type for RJ96114: 2
2026-03-28 11:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-28 11:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c783bb02-14be-539e-91af-d66b874db7ea, identifier: RJ96114
2026-03-28 11:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-28 11:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:26:45Z',
 'fuel_type': 'petrol',
 'id': '340ab20a-3fa7-56b0-9fac-6293aaedc5ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ38214',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 38851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Saving data for PJ38214: {'auction_closing_time': 1774715205.0, 'created_time': 1773917486.400141, 'last_price_update_time': 1774696435.107319}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ38214') HTTP/1.1" 204 0
2026-03-28 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-28 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-28 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114 to the API
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:39:27Z',
 'fuel_type': 'diesel',
 'id': 'c783bb02-14be-539e-91af-d66b874db7ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ96114',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 97249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Kia Optima 1.6 CRDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Saving data for RJ96114: {'auction_closing_time': 1774715967.0, 'created_time': 1774348870.351697, 'last_price_update_time': 1774696435.49261}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ96114') HTTP/1.1" 204 0
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Scrape type for TA14554: 2
2026-03-28 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-28 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca6367a3-acf5-5416-98e1-5bb9e61bada7, identifier: TA14554
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Scrape type for NP68778: 2
2026-03-28 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-28 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4737775-8f56-5c0c-9480-9c5b96a3afb4 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4737775-8f56-5c0c-9480-9c5b96a3afb4 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4737775-8f56-5c0c-9480-9c5b96a3afb4, identifier: NP68778
2026-03-28 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-28 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-28 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554 to the API
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:45:27Z',
 'fuel_type': 'diesel',
 'id': 'ca6367a3-acf5-5416-98e1-5bb9e61bada7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA14554',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 152714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Saving data for TA14554: {'auction_closing_time': 1774716327.0, 'created_time': 1774034070.955445, 'last_price_update_time': 1774696436.016864}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA14554') HTTP/1.1" 204 0
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-28 11:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778 to the API
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:24:40Z',
 'fuel_type': 'diesel',
 'id': 'b4737775-8f56-5c0c-9480-9c5b96a3afb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP68778',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 288153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-26',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Freestyle',
 'transmission': 'manual',
 'trim': 'Freestyle',
 'year': 2009}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Saving data for NP68778: {'auction_closing_time': 1774715080.0, 'created_time': 1774608338.882908, 'last_price_update_time': 1774696436.321115}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP68778') HTTP/1.1" 204 0
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Scrape type for HV14674: 2
2026-03-28 11:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-28 11:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b, identifier: HV14674
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Scrape type for MV46012: 2
2026-03-28 11:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-28 11:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1427a2ab-7707-55ac-a7ab-d428e7d19a39, identifier: MV46012
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-28 11:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674 to the API
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:13Z',
 'fuel_type': 'petrol',
 'id': '5b6065a7-f2e8-517f-9ebf-b3a66b65262b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV14674',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 71275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Saving data for HV14674: {'auction_closing_time': 1774716853.0, 'created_time': 1773344940.750079, 'last_price_update_time': 1774696436.834384}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV14674') HTTP/1.1" 204 0
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-28 11:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012 to the API
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:01Z',
 'fuel_type': 'petrol',
 'id': '1427a2ab-7707-55ac-a7ab-d428e7d19a39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46012',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 30528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2020}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Saving data for MV46012: {'auction_closing_time': 1774715161.0, 'created_time': 1774002392.822044, 'last_price_update_time': 1774696437.244799}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46012') HTTP/1.1" 204 0
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Scrape type for ZD28576: 2
2026-03-28 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-28 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643c22f9-9c40-5d40-9c79-b4aaf666f822, identifier: ZD28576
2026-03-28 11:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-28 11:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-28 11:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576 to the API
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:59Z',
 'fuel_type': 'diesel',
 'id': '643c22f9-9c40-5d40-9c79-b4aaf666f822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD28576',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 198583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2015}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Saving data for ZD28576: {'auction_closing_time': 1774716539.0, 'created_time': 1774608337.256713, 'last_price_update_time': 1774696437.696022}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD28576') HTTP/1.1" 204 0
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Scrape type for GB27977: 2
2026-03-28 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-28 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8e4afb-8d96-5a04-a092-38428b049634, identifier: GB27977
2026-03-28 11:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-28 11:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:07Z',
 'fuel_type': 'diesel',
 'id': '6b8e4afb-8d96-5a04-a092-38428b049634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27977',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 81671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2018}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Saving data for GB27977: {'auction_closing_time': 1774714507.0, 'created_time': 1774032130.796188, 'last_price_update_time': 1774696438.257261}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27977') HTTP/1.1" 204 0
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Scrape type for GH74073: 2
2026-03-28 11:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-28 11:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7be6b64-4dec-5cd6-849f-da7d39d696fa with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7be6b64-4dec-5cd6-849f-da7d39d696fa with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7be6b64-4dec-5cd6-849f-da7d39d696fa, identifier: GH74073
2026-03-28 11:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-28 11:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:11:22Z',
 'fuel_type': 'diesel',
 'id': 'c7be6b64-4dec-5cd6-849f-da7d39d696fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH74073',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 291267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Saving data for GH74073: {'auction_closing_time': 1774714282.0, 'created_time': 1774608332.946838, 'last_price_update_time': 1774696438.674388}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH74073') HTTP/1.1" 204 0
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Scrape type for SL27608: 2
2026-03-28 11:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-28 11:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea41838-591c-53a9-bb05-24d745d48a1e with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea41838-591c-53a9-bb05-24d745d48a1e with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ea41838-591c-53a9-bb05-24d745d48a1e, identifier: SL27608
2026-03-28 11:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-28 11:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:35:00Z',
 'fuel_type': 'petrol',
 'id': '8ea41838-591c-53a9-bb05-24d745d48a1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL27608',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 91083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Saving data for SL27608: {'auction_closing_time': 1774715700.0, 'created_time': 1774608320.578145, 'last_price_update_time': 1774696439.139482}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL27608') HTTP/1.1" 204 0
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Scrape type for DV41377: 2
2026-03-28 11:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-28 11:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43642e65-0815-5bf0-b640-6173f805d69a, identifier: DV41377
2026-03-28 11:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-28 11:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-28 11:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377 to the API
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:27Z',
 'fuel_type': 'petrol',
 'id': '43642e65-0815-5bf0-b640-6173f805d69a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41377',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 64357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2013}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Saving data for DV41377: {'auction_closing_time': 1774717107.0, 'created_time': 1774031494.790696, 'last_price_update_time': 1774696439.59649}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41377') HTTP/1.1" 204 0
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Scrape type for RR95104: 2
2026-03-28 11:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-28 11:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3ca586b-0878-5598-b264-ef661f73908e, identifier: RR95104
2026-03-28 11:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-28 11:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-28 11:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104 to the API
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:06:24Z',
 'fuel_type': 'diesel',
 'id': 'd3ca586b-0878-5598-b264-ef661f73908e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR95104',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 213283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2017}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for RR95104: {'auction_closing_time': 1774713984.0, 'created_time': 1773132415.151988, 'last_price_update_time': 1774696440.138112}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR95104') HTTP/1.1" 204 0
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Scrape type for RB29698: 2
2026-03-28 11:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-28 11:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a319af6a-c378-55f1-9170-ea84f8a6abf5, identifier: RB29698
2026-03-28 11:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-28 11:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-28 11:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698 to the API
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:18Z',
 'fuel_type': 'diesel',
 'id': 'a319af6a-c378-55f1-9170-ea84f8a6abf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB29698',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 294198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for RB29698: {'auction_closing_time': 1774715598.0, 'created_time': 1772541363.997127, 'last_price_update_time': 1774696440.578999}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB29698') HTTP/1.1" 204 0
2026-03-28 11:14:00 [auto1.de] INFO: Channel: 24h | Page: 241 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Scrape type for TJ54274: 2
2026-03-28 11:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-28 11:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2, identifier: TJ54274
2026-03-28 11:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-28 11:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-28 11:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274 to the API
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:46Z',
 'fuel_type': 'diesel',
 'id': 'fc1073af-f2da-5a7b-9024-ad2b9f9adbe2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ54274',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 234057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2019}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for TJ54274: {'auction_closing_time': 1774714546.0, 'created_time': 1773226336.737632, 'last_price_update_time': 1774696440.966796}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ54274') HTTP/1.1" 204 0
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for BN99160: 2
2026-03-28 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-28 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5712236d-f2e5-5810-88c4-2658be36ae46, identifier: BN99160
2026-03-28 11:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-28 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-28 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160 to the API
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:01:57Z',
 'fuel_type': 'petrol',
 'id': '5712236d-f2e5-5810-88c4-2658be36ae46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN99160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 120520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Saving data for BN99160: {'auction_closing_time': 1774713717.0, 'created_time': 1773302919.288023, 'last_price_update_time': 1774696441.425177}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN99160') HTTP/1.1" 204 0
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for XN26589: 2
2026-03-28 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-28 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74897efa-cfcb-5863-93d9-b0587ef97589 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74897efa-cfcb-5863-93d9-b0587ef97589 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74897efa-cfcb-5863-93d9-b0587ef97589, identifier: XN26589
2026-03-28 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-28 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-28 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589 to the API
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:55:24Z',
 'fuel_type': 'diesel',
 'id': '74897efa-cfcb-5863-93d9-b0587ef97589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26589',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 208478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-06',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Saving data for XN26589: {'auction_closing_time': 1774716924.0, 'created_time': 1774608401.123056, 'last_price_update_time': 1774696441.834702}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26589') HTTP/1.1" 204 0
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for HP95404: 2
2026-03-28 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-28 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1561db0f-b688-5d18-a454-650b34866fef, identifier: HP95404
2026-03-28 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-28 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-28 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404 to the API
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:44:18Z',
 'fuel_type': 'diesel',
 'id': '1561db0f-b688-5d18-a454-650b34866fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP95404',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 109213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Saving data for HP95404: {'auction_closing_time': 1774716258.0, 'created_time': 1773341653.53218, 'last_price_update_time': 1774696442.363987}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP95404') HTTP/1.1" 204 0
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Scrape type for AB73354: 2
2026-03-28 11:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-28 11:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978f3f63-a1b6-58e1-9375-8b891293ec15, identifier: AB73354
2026-03-28 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-28 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-28 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354 to the API
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:26:48Z',
 'fuel_type': 'diesel',
 'id': '978f3f63-a1b6-58e1-9375-8b891293ec15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB73354',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 114500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2020}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Saving data for AB73354: {'auction_closing_time': 1774715208.0, 'created_time': 1773427360.584378, 'last_price_update_time': 1774696442.784776}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB73354') HTTP/1.1" 204 0
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Scrape type for SZ74678: 2
2026-03-28 11:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-28 11:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e002cef3-cd69-5677-9a95-12f44a7e2500, identifier: SZ74678
2026-03-28 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-28 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-28 11:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678 to the API
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:58:06Z',
 'fuel_type': 'diesel',
 'id': 'e002cef3-cd69-5677-9a95-12f44a7e2500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ74678',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 135389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Saving data for SZ74678: {'auction_closing_time': 1774717086.0, 'created_time': 1773946477.792062, 'last_price_update_time': 1774696443.187335}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ74678') HTTP/1.1" 204 0
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Scrape type for RT76020: 2
2026-03-28 11:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-28 11:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc676309-1b4e-5257-8762-693ff4f864a1, identifier: RT76020
2026-03-28 11:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-28 11:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-28 11:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020 to the API
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:04:46Z',
 'fuel_type': 'petrol',
 'id': 'bc676309-1b4e-5257-8762-693ff4f864a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT76020',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 73695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-05',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Diamant Edition+',
 'transmission': 'manual',
 'trim': 'Diamant Edition+',
 'year': 2019}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Saving data for RT76020: {'auction_closing_time': 1774713886.0, 'created_time': 1774467484.714932, 'last_price_update_time': 1774696443.599114}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT76020') HTTP/1.1" 204 0
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Scrape type for SA17140: 2
2026-03-28 11:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-28 11:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f30114d-9415-58c7-92e8-2767ed86cde6, identifier: SA17140
2026-03-28 11:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-28 11:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-28 11:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140 to the API
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:34:00Z',
 'fuel_type': 'petrol',
 'id': '1f30114d-9415-58c7-92e8-2767ed86cde6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA17140',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 113973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-28 11:14:04 [auto1.de] INFO: Saving data for SA17140: {'auction_closing_time': 1774715640.0, 'created_time': 1774033696.031654, 'last_price_update_time': 1774696444.006698}
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA17140') HTTP/1.1" 204 0
2026-03-28 11:14:04 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 11:14:04 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-28 11:14:04 [auto1.de] INFO: Scrape type for VY78817: 2
2026-03-28 11:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-28 11:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-28 11:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-28 11:14:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a777c48e-71f4-55d1-934e-9c5a1a61975d, identifier: VY78817
2026-03-28 11:14:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-28 11:14:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-28 11:14:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817 to the API
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:03:57Z',
 'fuel_type': 'petrol',
 'id': 'a777c48e-71f4-55d1-934e-9c5a1a61975d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY78817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 190290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-28 11:14:04 [auto1.de] INFO: Saving data for VY78817: {'auction_closing_time': 1774713837.0, 'created_time': 1773916878.083809, 'last_price_update_time': 1774696444.473383}
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY78817') HTTP/1.1" 204 0
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Scrape type for AY50267: 2
2026-03-28 11:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-28 11:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b211273d-1071-5ded-b3c1-e6520b779bb6 with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b211273d-1071-5ded-b3c1-e6520b779bb6 with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b211273d-1071-5ded-b3c1-e6520b779bb6, identifier: AY50267
2026-03-28 11:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-28 11:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-28 11:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267 to the API
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:39:29Z',
 'fuel_type': 'diesel',
 'id': 'b211273d-1071-5ded-b3c1-e6520b779bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY50267',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 133844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Basis Kasten',
 'transmission': 'manual',
 'trim': 'Basis Kasten',
 'year': 2019}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Saving data for AY50267: {'auction_closing_time': 1774715969.0, 'created_time': 1774467394.748925, 'last_price_update_time': 1774696445.699469}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY50267') HTTP/1.1" 204 0
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Scrape type for HP12091: 2
2026-03-28 11:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-28 11:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e81ed744-89ee-5f5f-811c-d7066ab082ff, identifier: HP12091
2026-03-28 11:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-28 11:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-28 11:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091 to the API
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:10:22Z',
 'fuel_type': 'diesel',
 'id': 'e81ed744-89ee-5f5f-811c-d7066ab082ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP12091',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 180046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-03',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2011}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Saving data for HP12091: {'auction_closing_time': 1774714222.0, 'created_time': 1773304933.369629, 'last_price_update_time': 1774696446.131044}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP12091') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Scrape type for PB00515: 2
2026-03-28 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-28 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e1402e-8925-52ef-934e-c21e55e60c66, identifier: PB00515
2026-03-28 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-28 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-28 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515 to the API
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:05:45Z',
 'fuel_type': 'gas',
 'id': 'c6e1402e-8925-52ef-934e-c21e55e60c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB00515',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 26127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Journey',
 'transmission': 'manual',
 'trim': 'Journey',
 'year': 2023}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Saving data for PB00515: {'auction_closing_time': 1774713945.0, 'created_time': 1773429143.181395, 'last_price_update_time': 1774696446.550187}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB00515') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Scrape type for ZE10872: 2
2026-03-28 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-28 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452, identifier: ZE10872
2026-03-28 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-28 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-28 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872 to the API
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'diesel',
 'id': '8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE10872',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 237976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Saving data for ZE10872: {'auction_closing_time': 1774713810.0, 'created_time': 1774031832.62569, 'last_price_update_time': 1774696446.975309}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE10872') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Channel: 24h | Page: 242 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Scrape type for VE44500: 2
2026-03-28 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-28 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a, identifier: VE44500
2026-03-28 11:14:07 [scrapy.extensions.logstats] INFO: Crawled 448 pages (at 6 pages/min), scraped 1130 items (at 120 items/min)
2026-03-28 11:14:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-28 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-28 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500 to the API
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:15Z',
 'fuel_type': 'petrol',
 'id': '3de96f9d-f83e-52e8-a07b-8dd38e2cb28a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE44500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 104180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Saving data for VE44500: {'auction_closing_time': 1774715235.0, 'created_time': 1774468161.16167, 'last_price_update_time': 1774696447.386551}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE44500') HTTP/1.1" 204 0
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Scrape type for ZN04335: 2
2026-03-28 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-28 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64a51235-0f1f-53a6-bceb-284a0ab7ca50, identifier: ZN04335
2026-03-28 11:14:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Scrape type for KS08572: 2
2026-03-28 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-28 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9, identifier: KS08572
2026-03-28 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-28 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-28 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335 to the API
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:15:37Z',
 'fuel_type': 'diesel',
 'id': '64a51235-0f1f-53a6-bceb-284a0ab7ca50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN04335',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 224947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for ZN04335: {'auction_closing_time': 1774714537.0, 'created_time': 1773225996.144559, 'last_price_update_time': 1774696448.015809}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN04335') HTTP/1.1" 204 0
2026-03-28 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-28 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-28 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572 to the API
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 370,
 'expiration_date': '2026-03-28T16:33:57Z',
 'fuel_type': 'petrol',
 'id': '3fd6e3de-1a77-5330-9242-b7fb50f23bf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS08572',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stinger',
 'odometer': 36660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Kia Stinger 3.3 V6 TGDI GT 4WD',
 'transmission': 'automatic',
 'trim': 'GT 4WD',
 'year': 2018}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for KS08572: {'auction_closing_time': 1774715637.0, 'created_time': 1774435406.685547, 'last_price_update_time': 1774696448.305732}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS08572') HTTP/1.1" 204 0
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Scrape type for JR60766: 2
2026-03-28 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-28 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b603c23-5c31-5308-b575-782f1fdea21f, identifier: JR60766
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-28 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-28 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766 to the API
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': '4b603c23-5c31-5308-b575-782f1fdea21f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR60766',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 115661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for JR60766: {'auction_closing_time': 1774713997.0, 'created_time': 1773400661.702349, 'last_price_update_time': 1774696448.710489}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR60766') HTTP/1.1" 204 0
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Scrape type for TM66386: 2
2026-03-28 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-28 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7da4cd20-cd91-5649-8777-b14c8f2ea840, identifier: TM66386
2026-03-28 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-28 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-28 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386 to the API
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:12:28Z',
 'fuel_type': 'diesel',
 'id': '7da4cd20-cd91-5649-8777-b14c8f2ea840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM66386',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Saving data for TM66386: {'auction_closing_time': 1774714348.0, 'created_time': 1774349825.70511, 'last_price_update_time': 1774696449.218371}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM66386') HTTP/1.1" 204 0
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Scrape type for MH24339: 2
2026-03-28 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-28 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acea335d-749a-573e-9503-5e65dd24a15c, identifier: MH24339
2026-03-28 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-28 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-28 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339 to the API
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'diesel',
 'id': 'acea335d-749a-573e-9503-5e65dd24a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH24339',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 300246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Saving data for MH24339: {'auction_closing_time': 1774713686.0, 'created_time': 1773859421.609044, 'last_price_update_time': 1774696449.626696}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH24339') HTTP/1.1" 204 0
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Scrape type for KS94316: 2
2026-03-28 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-28 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf4f19c-9a14-54c3-8293-93f7d40e4257, identifier: KS94316
2026-03-28 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-28 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-28 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316 to the API
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:05:40Z',
 'fuel_type': 'gas',
 'id': 'bbf4f19c-9a14-54c3-8293-93f7d40e4257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS94316',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 77698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Opel Combo 1.4 Turbo Kasten L1H1 2,4t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,4t',
 'year': 2014}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Saving data for KS94316: {'auction_closing_time': 1774713940.0, 'created_time': 1772725963.182595, 'last_price_update_time': 1774696450.065916}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS94316') HTTP/1.1" 204 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for JR21224: 2
2026-03-28 11:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-28 11:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-28 11:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-28 11:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ccc8b5-084f-5d38-95de-9803e74d340e, identifier: JR21224
2026-03-28 11:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-28 11:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-28 11:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224 to the API
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:33:39Z',
 'fuel_type': 'petrol',
 'id': '72ccc8b5-084f-5d38-95de-9803e74d340e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR21224',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 152431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Saving data for JR21224: {'auction_closing_time': 1774715619.0, 'created_time': 1774349484.681611, 'last_price_update_time': 1774696450.453837}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR21224') HTTP/1.1" 204 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 11:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:10 [auto1.de] INFO: Channel: 24h | Page: 243 | totalHits: 9715 | hits on page: 35
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for BP51481: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for MR29539: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24285%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Scrape type for MD24285: 0
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-28 11:14:10 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-28 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97983%27 HTTP/1.1" 200 None
2026-03-28 11:14:11 [auto1.de] INFO: Scrape type for PB97983: 0
2026-03-28 11:14:11 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 11:14:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:11 [auto1.de] INFO: Channel: 24h | Page: 244 | totalHits: 9715 | hits on page: 0
2026-03-28 11:14:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:14:11 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-28 11:14:11 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 26, <ScrapeType.BATCH_SKIPPED: 5>: 35}
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774264452 HTTP/1.1" 200 None
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AB70277') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE32150') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AF40953') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AM77687') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT62154') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD67364') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE55111') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM00053') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP11097') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP69387') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS71293') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS91998') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW84058') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX89301') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ70287') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB44481') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC29120') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE00984') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF87259') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG32983') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG96227') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CL20648') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS58507') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS96512') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU68503') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CV83300') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC88123') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF64083') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK78914') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK80592') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU56840') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV43385') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA20625') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC92138') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN61568') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES43629') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FN53464') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP44607') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB53139') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF38052') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ42510') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ53536') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK27432') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV44074') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX79735') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA05201') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HF43463') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT68602') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB87044') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC51763') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF31252') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU28029') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW03646') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC23124') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE45513') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK84513') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL67471') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KN47550') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP87379') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KR53908') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV56642') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY83443') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD84714') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LH96490') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW82905') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA35074') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH95503') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN97981') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR72428') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW27042') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MX28428') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ38064') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ87926') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK87306') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NL07154') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NN03303') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NW52708') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX31792') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC40179') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00836') HTTP/1.1" 204 0
2026-03-28 11:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH90142') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PU80535') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW23929') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ70245') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF06599') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF41456') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN17720') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP13899') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP48449') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX12521') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX19152') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX71007') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY15008') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SC23766') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR13018') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR37693') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA62797') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TD52167') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ09039') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ48193') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP73711') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU04867') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ04417') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB37746') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE47520') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF09214') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG42405') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH31359') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR12476') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US01553') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV61749') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW39915') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF81617') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH80950') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN83567') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR85209') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW82524') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX15637') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL50157') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM78340') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU29227') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW72537') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ12208') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC20802') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD26124') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY36888') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY89058') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ84876') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YP95223') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YS53660') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT34986') HTTP/1.1" 204 0
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA23850') HTTP/1.1" 204 0
2026-03-28 11:14:13 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1138 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-28T10_30_00.jl
2026-03-28 11:14:13 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2063526,
 'downloader/request_count': 1043,
 'downloader/request_method_count/GET': 797,
 'downloader/request_method_count/POST': 246,
 'downloader/response_bytes': 697615354,
 'downloader/response_count': 1043,
 'downloader/response_status_count/200': 1043,
 'dupefilter/filtered': 18,
 'elapsed_time_seconds': 2646.450878,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 14, 13, 438555, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1138,
 'log_count/DEBUG': 23927,
 'log_count/INFO': 28720,
 'memusage/max': 204300288,
 'memusage/startup': 148123648,
 'photo_download_count': 593,
 'request_depth_max': 247,
 'response_received_count': 450,
 'scheduler/dequeued': 1043,
 'scheduler/dequeued/memory': 1043,
 'scheduler/enqueued': 1043,
 'scheduler/enqueued/memory': 1043,
 'scrape_type/batch_skipped': 4870,
 'scrape_type/new': 101,
 'scrape_type/price_update': 1037,
 'scrape_type/skipped': 3729,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 465,
 'scrapy-zyte-api/error_ratio': 0.03225806451612903,
 'scrapy-zyte-api/errors': 15,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 15,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.230711497747232,
 'scrapy-zyte-api/mean_response_seconds': 7.310221719915667,
 'scrapy-zyte-api/processed': 450,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 450,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 449,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 450,
 'scrapy-zyte-api/request_args/httpRequestBody': 246,
 'scrapy-zyte-api/request_args/httpRequestMethod': 246,
 'scrapy-zyte-api/request_args/httpResponseBody': 450,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 450,
 'scrapy-zyte-api/request_args/sessionContext': 450,
 'scrapy-zyte-api/request_args/url': 450,
 'scrapy-zyte-api/status_codes/0': 15,
 'scrapy-zyte-api/status_codes/200': 450,
 'scrapy-zyte-api/success': 450,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 9755,
 'source/total_available': 9715,
 'start_time': datetime.datetime(2026, 3, 28, 10, 30, 6, 987677, tzinfo=datetime.timezone.utc)}
2026-03-28 11:14:13 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:14:13 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdd5565a210>
2026-03-28 11:14:13 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdd557ac3d0>